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INTRODUCTION' . » 

• ■ 

The National Aeronautics and Space Administration (NASA) and many research and 
development organizations use the technical report as a primary medium for the com- 
munication and dissemination of research results, NASA' published 3,399 technical 
^reports in ,1980, for example. Six hundred .twelve of these repor^ts were published by 
the Langley Research Center (LaRC) . . / . ^ ' 

W survey of engineers and scientists at LaRC and in the academic/industrial 
* communities was conducted to determine the opinions of readers concerning the format 
(organization) of NASA technical reports and usage of report components. The ques- 
tionnaire .used for the study also elicited information concerning usage of scientific 
and technical information (STIJ , perceived image of NASA- and Langley-authored STI,. 
f and jdemographic data about the respondents. This report presents the results of the 
internal and 'external surveys in regard to the organization (format) of NASA techni- 
cal reports. 

STATEMENT OV/ THE PROBLEM 

NASA technical reports serve as. a primary means of communicating the results 
of NASA's research. Consequently, NASA technical reports must be organized and 
written to accomplish effective 'communication. NASA employs uniform publications 
standards which are designed to ensure the clarity, quality, and the utility of 
its technical reports. These standards include a basic report format which defines 
the report's components and^ establishes their sequence. The standards address, in 
a limited sense, language (verbal and visual) and presentation (typography, graphic 
design, and physic^al media) components. These standards had not been examined to 
determine the extent to which they contribute to the effectiveness of the NASA < 
technical report as a product for information* disseminat ion. However, there weYe 
no generally accepted standards against -which NASA publications standards for 
technical reports could be compared. . . 

^ As part of the review and evaluation-of the Langley Research Center's scientific 
and technical information (STI) program, the technical report Vas examined to deter- 
mine the organization of the report (sequential components) , the language used to 
convey the information (language^ components), aBd^t^ie methods used to ^present the 
information (presentation components). The exa/nin^tion inx:luded a survey of the.^:^. 
literature pertinent to the, subject and an anal/ysi-f of current usage and practices 
of publishers of technical reports'. The results of the examination were presented 
in NASA Technical Memorandum 83269. . / 

* No generally accepted structure for the organization (sequential cofnpon'ent?) 
'Of the report was found in the survey and analysis of the Technical report 
(McCul-lough, Pinelli, et al., 1982). The ^uifvey reports, style manuals and.publi- 
cations guides; and textbooks were not unified' in the number or names 'of components ' 
and the ^placement of components recommended for inclusion in technical reports. The 
results did not provide sufficient data aga,inst which the NASA format for technical 
rrpnrt comp o nents could be compareij, ^ Coni3(iiquontly , it wao rueummcndcd that a ^^reaclc r 
preference'* survey be cb^ucted among producers and user^ of NASA technical reports. 
The results would be Ju§ed,C}yith the data produced from the survey and analysis to 
form a standard (bench mark) against whic/i the I^ASA format for technical reports 
could be compared. 



Purpose of the Study 

The study utilized survey research. The purpose of ^he study was. threefold^ 
(1) to determine through a survey, of. the internal .population (Langley engineers and 
scientists) and the external population (engineers and scientists in the academic 
.and industrial communities) whi.ch report 'CpmpoilentS: are >' read and in what sequence; 
12) to-determine-t1ie ^^e of non-NASA, NASA -authored, and Langley-authored (publasbed) 
STI; and (3) to gather 'data as to the technical quality, the adequacy of data, the 
organization (format) ,< and the quality of\isual presentation to determine the per- 
r ceived image of NASA-- and Langley-authored (published) STI. ' ' " . 

f i ' — . 

Obiectives of the Study 
. Twelve objectives were established for the study. Thes^e objectives were to: 

r. Determine how the technical report is read; specifically, which components • 
are read and in .what sequence; 

2. ' Ascertain the effect of deleting or including certain report components; 

3. Gather data as to the preferred arrangement of report components; ^ 

4. - Ascertain the need for a summary and abstract--their length, location, 

and content; . , 

5. Determine whether the 'integration of illustrative material within the text 
is preferred and, if so, whether the. illustrative material is read before, , 
with, or after the text; ^ 

-6. Determine >flien illustrative material is not integrated whether it is read . 
before, with, or 'after the textj - , . • 

7. Ascertain which form of reference citation' is preferred; 

8. Gather data as to the usefulness of the' appendixes; what^they"^should ''^ 
include; anjd whether" they are read before, with, or after the text; 

' 9. Ascertain the helpfulness of glossaries and symbol lists and where they 

should appear in the report; ' . ' 

10. Gath'er data as to the technical quality, the adequacy of data, the' organi- 
zation (format), and the quality of visual presentation to determine the _ 
perceived- image of Langley-authored technical reports; . , ^ ' 

11. 'Determine the use of non-NASA, NASA-authored, and Langley-authored 
(published) STP; -and / 

12. Ascertain specific demographia information about the survey^ respondents 
.including field o-f refsearch, present professional duties, and type of 

' organization. ^, ' 
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Importance of the Study 

A survey of the literature disclosed that little empir^SFl. research has st).een 
devoted to determining how 'technic^ reports are Vead j?y engineers and scientists 
and, consequently, . the incliTsion -and 'sequence of technical report components. " The 
NASA technaoal report format, including the components and their s^quencS, had not 
been empirically tested. ^ Therefore,^ an investigation of report components and 
their sequence, which includes input from engineers and scientists who produce and 
use NASA technical reports, was deemed essential. . " • 

As^sumptions 

Underlying the conduct of the, study are certain assumptions, which we^e tested 
during the course of the study. These assumptions are giv^ri below. 

1. The summary, introduction, conclusions, and illustrative material are read 
most frequently. 

2. One or ^ore of the aforementfoned components may^be the only one(s) read; 
therefore, each of th§se components should be independent of the remaining 
components. ^ . ^ . ' 

3. The abstract, along with tlTe\c6nQlusions, is sufficient to summarize the 
report thereby 'negating the need for a summary. 

4. , Xhe reading of the entire report may well depend upon the ability of the 
'.introduction^ and conclusions to hold, the reader's interest. 

5. The 'technical report is read by audiences having diverse technical back- 
grounds and should be understandable to those wha are. n'ot e)*pert in its 
subject. . . • 



Limitations 



of \h 



he Study 



The study was specifically concerned wit}}' the preferences ^of readers relative 
to the format of NASA technical reports. /P];:pfer^ces were limited to engineers and 
scientists assigned to the Aeronautics, tlectronics. Structures, and Space director- 
ates at the NASA Langley Research Center/ and, non-NASA engineers and scientists' 
chosen at random from three professionalVtechnigal societies who agreed to partici- 
pate in the' study. In ternfS of data reduction, no attempts were made. -Jo distinguish 
between th^ responses of the researchers (approximately TC^ercent of the respondents) 
and the technical managers (approximately 30 percent of the respondents) . 

The stJdy was limited to (1) 'searches of 10 manual and* machine-readable data 
bases; (2) style^manuals, publications guides, and ..textbooks! (3) books, periodi- '* 
cals,. reports,- conference prja^e^dings; and (4) research specifically\conce*ed with 
the technical report and such factors as reading^ habits, use- patterns, order of use, 
and components usage. The study spanned the period from ^September 1981 to Ap^Pi±:iJL982. 

N . : . ^ ^ . . . 
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^ " . DEFINltlbN bR;TERMS ' ' ^ ' 

Abstract > The abstract was defined 'as a technical report component consisting 
of a concise (approximately 300 words) but informative statement of a paper's 
purpose, research methods, and conclusions. The abstract is designed t© stand 
ii^ependent of the paper itself (thus excluding undefined symbols and references) 
ana to encourage the interest of a potential reader. 

' hack matter . Back matter of a technical report was defined as the section 
immediately following the body or^text. Supplemental materials Slich as appendixes, 
index, references, aod bibliography appear in this section. 

Body or text . The body or text of a technical report was defined as the 
section immediately following the front matter. The development of the central 
theme of the report,^ including the introduction; the . investigative, analytical, or 
theoretical material; the description of the. research; the results and discussion;' 
and the conclusions appear in thi^ section. - , 

Conclusion . The conclusion wars defined as a techni-cal report component con- 
sisting of a summation of findings, conclusions, and recommendations independent of 
the text. The conclusion also usually includes a brief ^introduction to the subject 
and purpose of the paper. 

.» * • 

External population . The external population in. this study was defined as 
those non-NASA engineers and scientists holding membership intone of three profes- 
sional/technical organizat ions« K ^ 

Front matter. Front matter of a technica-l report was defined as ^e section ^ 
immediately preceding the body or text. Included-in this section are the foreword, 
preface, and contents. This section^ is related only to the writing of the technical 
report itself and is not essential to the subject matter. 

Illustrative materi^^l . Illustrati/ve -material was interpreted in this ref^ort 
to be all visual representatipns. As used herein, illustrative material includes 
tables, drawings, graphs, and photographs. 



,:ernal population . The internal population in this study was defined as 
those engineers and scientists assigned to the ^Aeronautics , Electronics, Space, and 
Structures Directorates at Langley Research Center. 

NASA technical paper . The technical paper (TP) was«defined as a recos'd, subject 
to professional review, of the significant findings of work conducted by NASA 
sc^.entific and technical personnel. The technical paper is considered to be NASA's 

counterpart to the peer-reviewed journal article. 

_ , ^— - ^ 

NASA technical report format . The format for NASA foriiiaJ#|reports was inter- 
preted to consist of (in the order of appearance) the title page, summary, intrp- 
duction, symbols list, description of procedure and apparatus, results and discus- 
sion, conclusion, appendixes, references, tables, figures, and the standard COSATI 
page (containing the abstract). ^ 

Summary ^ The summary was defined as st' technical report component which pro- 
vides an overview of the principal ideas of the 'entire paper including such^ items 

as the introduction, investigative procedure, and findings. 

** 
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Symbol list or glossary . The symbol list or glossary was defined as a techni- 
cal report component which alphabetically lists all symbols, abbreviations, acronyms 
and/or technical terms included in the report and provides a definition of each/ 

Technical report . The technical report was .defined as an information product 
designed to xpnvey the comprehensive results of basic and applied research to an 
external audience. 'Included in the technical report was the ancillary information 
necessary for the interpretation, replication, and application of the results or 
techniques. 



GLOSSARY 

COSATI Committee on Sci^^ntij^ic and Technical Information 

DoD Department of Defense 

DoE ' Department of Jnergy 

LaRC Langley Research Center 

n Sample Size 

NACA National Advisbry Committee for Aeronautics 

NASA National Aeronautics and Space Administration 

NMI NASA Management Instruction 

P Population Proportion 

p. • Sample Proportion ^ 

R§D, Researcli and Development 

SATCOM Committee on Scientific and Technical Communication 

SPSS ^ Statistical Package for the Social Sciences 

STI Scientific and Technical Informatim- ^ 

RELATED RESEARCH AND IITERATURE ' 



The historical developments of technical report literature have been presented 
Ty TaTrmaWTr9"620', Bbyland^^^ Auger (1975). The complexity of technical" 

report literature^ has been described by several authors (Wright^ 1963 and Hartas, 
1966): Studies by Earle and Vickery (1969) and Coile (1969) determined the use 
of technical reports as citations in scientific and technical publications such as 
books, -periodicals., and monographs. Wilson (1958), Fuccillo (1967), and Randall 
(1959) coipducted Separate studies to determine the half-life of technical reports. 
Th€ SATCOM Committee (National Academy of Sciences, Nation Academy of Engineering, 
V^S) and the report of the Weinberg Panel (Executive Office of the President, 1963) 
w\ ^e con cgmed with the structure, organization, and transfer of scientific and 
technical information and the role of the technical report within an STI system. 



Perhaps the largest and most comprehensive , studies devoted to'the technical report 
were conducted by the American Psychological Association (Garvey and Griffith, 1965) 
and a COSATI Task Group (19^8:) under the direction of Sidney Passman. 

Various dimensions of the technical report have been studied. Many^ if not^^ 
most, of these studies were limited in scope and were devoted to the use of the 
technical report within the broader context of scientific and technical communica- 
tion. ' • 

History and Growth of Technical Report Literature 

According to Brearley (1973), scientists were exchanging reports with one 
another long before scientific communication was institutionalized. He further 
^suggested that technical reports may predate scientific journals. Auger (1975) 
stated that the history of tecl]nical report literature coincides entirely with the 
development of aeronautics and the aircraft industry. He further stated that in 
the United States the aircraft industry" has been represented continuously by the 
National Advisory Committee for Aeronautics (NACA) , now known as the National 
Aeronautics and Space Administration (NASA), which issued^ its first technical report 
on/ The Behaviour of Aeroplanes in Gusts in 1915. However, as Auger- points out, 
some authorities consider that these dates are anticipated by publicatipns which 
were reports in all but name, notably the Professional Papers of .the United States 
Geological Survey which appeared in 1902 and the Technologic Pap ers of the 
National Bureau of Standards which were first published in 1910. The development 
of the technical repojt as a major means of communication, according to several 
authorities such as Auger (1975), dates back to about, 1941, with the establishment 
on June 28 of the United States Office of Scientific Research and Development. 

" Grogan (1976) agreed with Brearley that scientists have been writing reports 
since the earliest days; wh^t has changed over the years has been their, methpd of 
communicating these reports. In describing the development of scientific communi- 
cation, X^rogan (1976) stated that dissemination of research was made first through 
personal correspondence and then through papers given at society meetings. As 
science grew and became more specialized, the journal became the accepted method 
af reporting new work. However, as the grov;th of science and technology began to 
rapidly escalate, the scientific journal was no longer capable of meeting the total 
information needs of the researcher. The technical report, according to Grogan 
(1976), emerged as an alternative method of disseminatTng the results of research. 

The volume of technical report literature has increased proportionally to the 
increase in government spending for research and^ development (R§D) (Subramanyam, . 
198L). For many R§D agencies of the federal government, including the National 
Aeronautics and Space Administration, the technical report constitutes an informa- 
tion product, a primary means of communicating the results of research to the user 
(Stohrer and Pinelli, 1981). ^ 



During the past 40 years, the technical report has developed into an important 
medium of communication in science and technology to the extent that it has some- , 
times been viewed as a threat to the scientific journal. Prior to World War II, 
the technical report was used primarily by industry and by agencies of the federal 
government. Due primarily to'the federal government's support of R§D activities 
and the associated need to record the progress and document the results of govern- 
ment-performed and -sponsared research, the volume of technical xeport literature 
has grown steadily. In 1973, approximately 80-85 percent of the world's technical ♦ 
report literature was of U.S. origin (Chillag, 1973). 




^umerous technical reports are issued annually; the exact numbers are unknown 
because production figures are usually obtained from a variety of sources. Produc- 
tion figures usually do not include those reports which are classified or limited 
in distribution. In fiscal year 1963, of the 38,880 technical reports produced by 
or for the U.S. Department of Defense (DoD) , 62 percent were subject to limited or 
restricted distribution (Hall, 1967). A similar case can be made for technical 
reports which document the results of industrial research. Quite often this 
research is considered proprietary 3C9 is subject to restricted distribution. 

By 1950, the annual output of technical reports in the U.S. was placed at 
between 75,000 and 100,000 (Tallman, 1961). According to the 1963MVeinberg report, 
some 100,000 tethnical reports were being issued each year in the U.S. alone 
(Grogan, 1970). By 1965, the number of technical reports had decreased to 15,00i3. 
A decade later, in 1975, the yearly total of technical reports being produced in the 
U.S. exceeded 60,000. The projected production for 1980 was estimated at 80,000 
technical reports (King, r977) . The nun*er of U.S. produced technical reports as 
compared with other STI media is showr^in Figure 1. ' 
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Figure 1. Number of U.S. STI literature items by medium (1960-1980) 



Technical Report Production by NASA 



^ All significant scientific and technical findings derived from NASA activities, 
i^^4^£ling those generated by NASA-sponsored R§D and related efforts, are dissemi- 
nated either in NASA technical publications and/or in suitable non-NASA scientific 
and technical media such as journals, ^conference proceedings, symposia, and work- 
shops. Accordingly,^ NASA operates a scientific and .t:echnical information program 
to acquire, process, announce, publish, and disseminate STI required for or resulting 
from, its research activities (NMI 2220^A). Central *to the operation of the NASA STI 
program is the NASA STI Facility, which acts as the clearinghouse for NASA STI; the 
NASA STI Branch at NASA Headquarters, whicj; has functional management responsibility 



for the program; and the NASA STI operations at each of the NASA field centers, which 
are responsible for managing their center ''s^ STI output. The total research output 
for the Agency from 1971rl981 appears in Figure 2. 

NASA technical reports constitute a primary means of , communicating the results 
of research to the user, NASA's history of technical report product ion dates back to 
and is built upon the heritage established by its predecessor, the National Advisory 
Committee for Aeron^autics (NACA) , The NASA technical publications series included 
several categories of technical reports, each designed to accomplish a specific 
purpose or function. Uniform publications standards designed to ensure the clarity, 
quality, and the utility of its technical reports are employed by NASA (NASA, 1974). 



Accession Year 



STI Media 


1971 


1972 


1973 


1974 


1975 


1976 


1977 


1978 


1979 


1980 


1981 


Totals 


Formal Reports 


1131 


898 


704 


736 


590 


' 530 


506 


440 


420 


420 


3or 


6676 


Contractor Reports 


2112 


3440 


3891 


3023 


2735 


2570 


262? 


2078 


2121 


1572 


2355 


30,144^ 


Informal Reports 


2088 


2189 


1811 


2525 


1- 

1926 


1613 


IBlfi 


|, 1430 


1318 


1407 


2386 


20.204 


Other Published 
Literature 


5125 


4502 


4775 


4687 


4587 


4527 


4614 


M547 


5038 


4563 


4527 


51,492 


Touts 


12,076 


11,029 


11,181 


10,971 


9,838 


9,240 


9,258 ^,458 


8,895 


7,962 


9,569 


108,516 



Figure 2, Total agency STI output for 19'71-1981 by medium 



Use and'^Assgssment of NASA Techni(;al Reports 
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In 1978, the NASA Ames Research Center contracted with Communimetrics, Inc., ' 
to undertake an evaluation of NASA STI from the viewpooni pf non-NASA users in the 
aeronautical industry, Monge (1979) based The Assessment of NASA Technical ihforma- 
tdon on data obtained from 450 employees in 40 of the 49 major aeronautical companies. 
Three methods of obtaining information were used: a questionnaire containing open- 
and closed-ended questions, structured interviews, and a multidimensional sca^ling 
technique. ^ , • ♦ ' 

Overall, the respondents registered a highly positive perception of NASA STI 
and, in particular, NASA technical publications. In terms of which publications were 
most helpful in their work, both executives (30 pereent) and researchers (28 percent) 
reported that journal publications were the most frequent source of technical infor^ 
mation, NASA technical publications were the next most frequently listed source or 
technical information by both groups (25 percent and 22 percent) . According to 
Monge, tTiese^ata Tn^Tcate tTiat, T.n teMs of the technical information available to 
industrial ^pers^onneJUJiA technical ^Sif^xmX)s^s^^ ^ 
second only to journals in the field, many of which are authored and co-authored by 
NASA personnel . " , 

The s|^cific content of NASA technical publication^was cited by executives 
(57 percent) and researchers (69 percent) as, the major benefit of receiving NASA 
technical reports, a_ltho_ug^h executives, more than__r_esearchers _aJs_o_ c_i_t_ed assistance__ 
with planning and pxpblem-solving and assistance in working with NASA as relatively 
important benefits (Monge, 1979). According to Monge, content generally was not 
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seen as a major inadequacy of NASA^echnical reports. For both executives and 
researchers, the data presented in NASA technical reports ^was adequate. Generally, 
writing style was not a jfiajor problem, although the executives preferred a less ^ 
formal, tutorial style. 

The respondents to the Monge study expressed sjsveral concerns relative to the 
content and presentation of NASA technical reports. These concerns were expressed 
in terms"of recommendations for change. 

r 

The respondents expressed the desire for NASA to produce more state-of-the-art 
publications. It was reported that one of the major inadequacies of NASA technical 
reports was the failure' to effectively relate the findings of 'a new research project 
to existing knowledge and similar research being conducted. It was recommended that 
each NASA technical report should have a section which synthesizes othe'r relevant 
research from within and outside of NASA. 

The Monge study further concluded' that existing standards and actual practice 
for technical reports resulting from' contractual arrangements "should be reviewed to 
assure greater consistency of these i*%ports with those produced within NASA. 
Summaries and abstracts should be clear and concise. It was recommended that 
abstracts should provide an overall description of the research while the summary 
should contain the essence of the findings or results and that the practice of not 
developing conclusions in NASA technical .reports should be exajnined. 

It was recommended by Mong'e that t-he* style and quality of graphics used in NASA 
t?echnical reports should^ be 'reviewed for consistency and -appearance. In particular, 
graphs, charts, and illustrative material should be examined for compliance" to 
"standards. IVhere stiandirds for graphics, for example, do not exist, they should be 
created. Particular emphasis should be place3 on grids and type size.' ^ 

The Monge study further concludecTthat the typography used, in'NASA technical ' - 
reports should be examined for unifoxrnity. rThe type size in some cases was too 
small, the typ^e style too flight, and the line length inappropriate. The type of 
binding used for NASA technical reports should a:lso be examined,' particularly for 
those technical reports which are considered to be informal. A type ,of binding which 
would permit the repo^^^ to lie flat and remain open was recommended. Tinally, it was 
recommended that NASA technical reports should contain information which would permit 
the reader to contact the author. This could include both a mailing address and 
business phone number. 

\ • In 1980, the NASA.Langley Research Center undertook a comprehensive review and 
evaluation of its STI program. A series of studies were conducted to determine the 
extent to which the program was* meeting the information needs of Langley research 
personnel and ngn-NASA users Tacademic and industrial researchers), the areas of the 
jproj:ram whJ.ch needed J-mprovement^^ the ways in which the ^program' could be modified, 
to improve its overall efficiency and effectiveness. 

Phase I (Pinelli, 1980) of, the review and evaluation study involved a survey of 
Langley engineers and scientists in the four research directorates. The questionnaire 
contained SO closed-ended" and 3 open-ended questions. From the internal user popu- 
lation of 1,036 engineers and scientists, 710 valid surveys were returned. From 
the valid surveys, a random sample of 300 Vas selected and subjected to. analysis. 
The survey collected infx>rmation on s^ix topics including the perceived image of NASA 
and Langley STI. . " 
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Phase IV (Pinelli, 1981) of the review and evaluation study involved a survey 
'of academic and industrial research personnel. TJie questionnaire contained 35 
closed-ended and 3 open-ended questions. From a contact list of nearly 1,200 active 
academic and industrial researchers, approximately 600 addresses were verified. The 
497 person? who agreed to participate were mailed questionnaires from which 3?1 com- 
pleted questionnaires were received by the cufoff date. The survey collected infor- 
mation on seven topics including the perceived image of NASA- and Langley-authored 
STI. 

The questionnaires administered to both populations covered such dimensions 
'as the prestige of iangley-authored journal articles and technical reports (as 
compared to other technical literature within the respondent's discipline) and the 
adequacy of data and the effectiveness of, report organization (format) of Langley- 
authored technical reports. The results^ of this portion of the questionnaires were 
compared to determine if similar perceptions and use were shared by the internal and 
external populations (Pinelli, Cross, et al.', 1981). 

Two questions were included in th'e' surveys of the internal and external popula- 
tions to establish the prestige (image) of Langley-authored STI. . C9ncerning Langley 
authored journal articles, 56 percent of the internal population indicated that the 
prestige was high as compared to 35 percent of the external population (spe Table A) 
Concerning Langley-authored technical reports, 48 percent of the internal population 
indicat*ed that the prestige was high as compared to 41 percent of the external popu- 
lation (see Table A)-. 

TABLE A 

Sumuiary: A Comparison of Perceived Prestige for Langley- 
Authored (Published) STI 



PERCENTAGES 



External 





High 


Neither 


Low 


No 
opinion 




High 


Neither 


Low 


Unfamiliar 
' with 


When compar'ed to 
other journal 
articles in my 
discipline, the 
prestige of 
' Langl ey-authdred 
joi^rnal articles 


56 


16 


8 


19 

fl 




35 


42 

1 


5 


i 

is 




















\Vhen compared* to- 
other literature 
in jny discipline, 
the prestige of 
Langley-authored 
formal Series 
publicatrions is 




















48 


15 


23 


24 




41 


36 

1 


5 


18 



n = 300 



-n = 381 
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An analysis of the findings revealed that, overall, the prestige of Langley- 
authored (published) STI was perceived as being higher by the internal population 
than by the external population. However, a perception of lower prestige for the 
Langley-authoted technical reports was indicated more frequently by the internal 
population than by the external population. Furthermore, the internal population 
attributed higher prestige to Langley-authored journal articles than did the exter- 
nal population.. Analysis of the internal population's responses concerning Langley- 
authored journal articles and technical reports revealed significant differences in 
-the perception of prestige within certain disciplines. Since the overwhelming 
majority of the internal population rated the quality of Langley STI high, the 
inference can be drawn that respondents in certain disciplines perceived that their 
research was viewed with less prestige by engineers and scientists outside the 
Langley Research Center. However, an analysis of the external populatioir responses 
to the perception of prestige did not reveal significant differences within disci- 
plines. 

Two questions were include'd in the internal and external surveys to establish 
two dimensions of technical quality: the effectiveness of report organi-zation * 
(format) and the adequacy of data for Langley-authored technical reports. Seventy- 
one percent of the internal population indicated that the prganization (format) of 
Langley-authored formal series, technical. reports made readability easy as compared 
to 47 percent of the external population (see Table B) . -Seventy-two percent of the . 
internal population indicated that the data contained in Langley-authored formal 
series technical reports were sufficient as compared to the resflonses of 48 percent 
of the -external population (see Table B) . - . * 



TABLE B 



Summary; A Comparison of Organization and Adequacy of Data for 
Langley-Authored Technical Reports , 



PERtENTAGES 



Internal 



External 





High 


Neither 


Low 


No 
opinion 


High 


Neither 


Low 


Unfamiliar 
with 


The* organization 
(format) of 
Langley. formal 
series publica- 
tions makes read- 
ability easy 


71 


15 


5 


9 


47 


* 

32 


3 


< 

18 


'^When compared to 
- other technical 
report 1 it eratur e , - 
the adequacy of 
data in Langley- ^ 
authored technical 
reports is suf- 
ficient 


72 


12 

4 


3 


13 

• 


^ 

48 

t 


32 


2 


« 

18 



n = 300 



«n = 381 
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An analysis of the ftndiDgs revealed that, overall, the effectiveness of the 
report organization (format) and the adequacy of data were perceived as being 
higher by the internal population than by the external population. Neither the ^ 
internal nor the external populations indicated that the organization (format) of 
Langley-authored technical reports made them less readable. Likewise, neither 
population indicated that the adequacy of data iri Langley-authored technical reports 
was low. However, the external population expressed the following concerns about 
NASA technical reports: (1) the separation of text from the visual material, (2) the 
absence of grids from graphs, (3)^ insyfficient tabular data, and (4) the exclusion 
of negative results. 

.Audience Analysis as a Function of Report Organization 

The organization (sequential components) of the technical report was examined^ 
as part of the survey^ and analysis of the technical report conducted by HcCullough, 
Pinelli, et al., (1982). In that study, technical reports obtained from report 
producers were analyzed. The structural components and their arrangement were 
compared with the current practice and usage as recommended by six style manuals 
and publications guides and six writing and editing textbooks. 

The survey reports showed wide variation in the numl5fer, kind, and placement of 
sequential components. The 99 reports surveyed used 96 different components with 
only five components common to half or more of the reports. The six style manuals 
and publications guides were not unified In the number and names of the components 
recommended for inclusion in technical reports. Sixteen of twenty-four components 
' were recommended by half or more of these sources^; however, unanimous agreement for 
inclusion"* existed for only threB components. Textbooks showed the greatest agree- 
ment on whiQh ccynponents should be considered, for inclusion in technical reports. 

McCullough, Pinelli, et al., (198^) pqstulated that variation in comfjonent 
inclusion and sequence may be attributed* to the content, purpose, apd audience being 
addressed. The ^nature of the report --whether it is informatiVe, analytical, or | 
assertive--may also contribute to the variation. The assumption is^that the struc- ^ 
tural components to be included in a technical^ report and their arrangement are a ^ 
functiorr of thQ reader's information needs and habits'. 

Authors of technical writing and editing textbooks pointed out the need for a 
flexible organizational structure and the need of the technical report writer to 
know precisely who will read the report. Houp and Pearsall (1980) stated that a 
technical report mus^t suit the needs, abilities, and interests of its principal 
users and referred to the many kinds of people the report must satisfy. -Mathis and 
^ Stevenson (1976) referred to the operational, objective; and personal characteristics 
! of the individual report readers and recommended audience analysis as a major step in 
the preparation and writing of the technical report. In their book/ Writing That 

Works^aUu^ et al.^ (19-Ba) stated^that the wxite_T, in determining the ne^ds^of the^ 

^ . reader, must identify who the reader -is and that different readers have different 
needs depending upon their jobs. Mills-and Walter (1^8) discus^sed the importance 
of adapting the style of the report to, first, the state- of the reader's knowledg;e^ of 
the subject and, second, the -total situation in which the reader examines and uses 
the retiort. 

t 

Souther and White (1977) stated that while engineers and scientists write for a 
variety af midiences, two groi:ips of readers are particularly important-- ^ - 
technical managers and professional colleagues. They further stated that too little 
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is knom about either the informational needs or the reading habits of these 
readers ancl that effective communication actually requires either a good knowledge 
'of both groups or some very accurate assumptions concerning them. Based on the 
results of an extensive review of the published literature contained in 10 manual 
and machine-readable data bases, there is little empirical evidence to conclude 
that the reading habits of engineers and scientists are known in terms of how they 
read technical reports, specifically which cgmponents are^ read and in what sequence. 

How the Technical Report Is Read 

• pi* • 

Numerous studies have been devoted to the percentage of time devoted by ^gi'- 
neers and scientists to reading-the professional literature as a function of their 
professional duties. Several studies on the information gathering habits. of, 
engineers and scientfsts have determined the various literature sources used by 
researchers. In hi3' survey of technical managers and researchers in the aero- 
nautical industry, Monge (1979) found that journals, followed by technical reports, 
were used to obtain information necessary to their research. Pinelli (1981) fo^und 
little difference in the use of journal articles, technical reports, and conference/ 
meeting papers by non-NASA engineers and scientists. In a survey conducted by King 
Research (King, Griffiths, et al., 1982) for the U.S. Department o£ Energy (DoE>, 
engineers and scientists funded by DoE were found to be readitig 9.8 journal" articles 
and 9.2 technical reports per month.* The methods of identifying technical reports 
read by DoE engineers and scientists appear below. 

Method of 



identification 


Technical reports, %* 




While browsing/distribution copy 


52 


• 


From another person (i*e., a colleague) 


24 




Cited iji another article/report 


8 




Cited in a printed index 






In the output of a cdmputerized literature 


* 




search 


12 




*'King Research, Inc., surveys of DoE-funded 


scientists and engineers 


1^ 



The reading habits of engineers and scieJhtists may be 'viewed two ways. ^ 
First, ^ the engitieer or scientist must decide to read/obtain or not read/obtain 
a report. Pullen and Hoffman (1970), in their article, "Is the Report Worth 
Reading?'* stated that this decision must be made by every engineer and scientist in^ 
his/her search for vital information or data needed ifor his/her research. The title 
and abstract were cited as key factors used by engineers and scientists in the ^ 
decision process. Thompson (1970), as' part of a field experiment conducted in three 
military laboratori es, asked 8 5 engineers and scientists to provide data concerning 
their use of journals and technical Reports which, in the normal 'course of events, 
arrived at theias^desk. In terms of "what to d,o with the material," participants 
were asked how they arrived at their decision. Better than half^(57 percent) of the 
decisiorfs were based oh the title, followed by the abstract, the table of contents, 
the introduction, and skimming the text. Of the material that arrived at their desk, 
53 percent was read immediate^^and 24 percent -was held fpr later reading. In 
another study, Thompson (I973j conducted a field experiment to determine the .extent. 

wJiich abstracts may be used by. engineers and scient ists in determining whether to 
read/not read an article or report. Thompson concluded that the addition of a 
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separate, identifiable abstract at the beginning of a report or journal article, 
does not irtcrease the abilitiy of the. readers to decide what disposition to make of ^ 
the article or report. He did conclude that the title and associated information 
resulJ^e^ in 'quicker disposition decisions', and that disposition decisions are 
apparently based on a variety of ^cues. In terms of'time taken and quality of 
relevant judgment, these other cues are at least as effective as the abstract. 

Secondly, once a decision is made to read the report, how is the report read and 
specifically, which components are read and in what sequence. Research regarding hqjv 
engineers and scientis.ts read technical reports is limited. What little published 
literature does exist pertains more to the reading habits of*technical managers than 
to researchers ox ''bench scientists. Souther and White (1977) implied that the 
reading habits as. well as the informational needs of , the two groups differ. This 
difference in terms of information needs is supported in part by the findings of 
the Monge study and the specific benefits derived from NASA technical reports by 
technical managers and researchers. 

Turner (1974)' stated that technical manager^ have numerous demands placed on 
their time. Insofar as technical reports are concerned. Turner pointed out that 
the majority of managers only have tyne to read the summary. In a survey of techni- . 
cal managers in several large engineering enterprises. Turner found that, as shown ^ 
below, 87 percent of the technical managers who received technical reports read the 
summaries while only 12 percent referred to the main body or text. 



Parts of Technical Reprorts 
That Managers Read 



Percentage of 

Part of report , managers reading 

part* 



Summary 87 

Introduction • 43 

Main body 12 

Conclusions 55 

Appendices ' 5 



^Sample size, 287 



. Perhaps the most comprehensive study of the information needs and reading 
habits of technical managers was conducted by Mouther for the Westinghouse Corpora- 
tion The purpose of Souther^-s- study -(4962)-wa^to 4denti-fy the infotmation needs 
of management and to determine how managers use reports and their reading habits. 
The study identified five Ibfbad Teclfnoaogical areas of primary interest to technical 
management. These areas are shown below. 

0 Technical problems 

0 New projects and products 

o Experiments and tests 

0 Materials and processes 

0 Field troubles 



23 
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In addition to the five technological areas, ^Souther stated that the manager , . 
must also consider orjganizational problems and market factors. Although such 
•problems and factors may not be a primary concern to engineers and scientists, thfey 
* should include the information in reports going to their management. According to 
Souther, 'these five areas of interest are important for two reasons. They pinpoint 
more accurately the actual information needs of the management reader. These areas 
point directly to the necessity of relating the technical report to industrial 
decision-making. According to Souther, this is an important concept often overlooked 
in advice on technical writing. 

In terms of their report reading habits, members^of the technical staff ranked^, 
their information needs in order of importance as follows. 



*Items Most ,Often Looked Fof Weighted scale 



Conclusions and recommendations 




79 


Statement of the problem 




76 


Approach used 




62 


General concepts 




58 


Special problems 




50 


Results 




45 


- (and at the bottom of the list) 






Detailed data 




16 



*Source: Souther and IVhite, 1977, -p. 20 



Souther concluded from this portion of his study that how a researcher writes a 
report is altogether different from what a researcher looks for when reading a 
report. According to Souther, this, too, is an important concept often overlooked 
in advice on technical writing. - . 

Summary . . * ' 

The technical report has grown in number and in use to become a primary 
inforijiat ion product for the dissemination of scientific and technical infor-mation. 
The number of technical reports produced each year is directly proportional to 
government support o£ research/ and development. 

The evaluation of NASA technical reports has bjeen confined to feedback obtained 
from users. This feedback indicated that NASA technical reports were being used, 
that their perceived prestige was high, that tlie organization (format) made read- 
abilit y eas y, §nd that' the adequacy of data was sufficient. ' 



In terms o£ deciding to read/obtain a technical report-^- tho-Xit le followed hy — 
the abstract, the table of contents, and the introduction were the components most 
frequently uSkd in the decision-making process. The reading habits and information 
needs of the technical manager and the research were perceived to differ. From the^ 
standpoint of empirical researcji, more is known about the reading habi^ts/ information 
needs of the technical manager than the researcher. • x 
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RESEARCH METHODOLOGY AND PROCEDURE y 

The study used survey research methods to obtain feedback from Langley engi- 
neers and scientists assigned to the Aeronautics^ Electronics, Structures, and Space 
Directorates and from engineers and scientists in- the academic and industrial com- - 
munities. The study was conducted in conjunction with Continental Research. Pro-' 
fession^l research assistance was used to establish and^ensure objectivity and 
confidentiality, to maintain the integrity of the study* and to^ obtain research 
skills not otherwise readily available to the project. " ^ , . 

Research Methodology * . ' . - 

The methodology for the survey portion of the study was based on ^he work of 
Fishbein and Ajzen (1975), This methodology combined the semantic differential 
technique, taken from communication research, with the concepts of cl"^ssical and 
operant conditioning, taken from learning theory. (For a discussion of these con- 
cepts, see Hilgard and Brower, 1966.) This methodology has been used to assess 
attitudes toward such diverse topics^s using birth control pills (Jaccard ^nd 
Davidson, 1972), voting for a political candidate (Fishbein and Coombs, 1974), and 
buying consumer products (Sheth and Thlarzyk, 1972). This methodology was also used 
in Phase I (Pinelli, et al., 1980) ant Phase IV (Pinelli, et al., 1981) of the 
Langley STI review and evaluation stuJly. While others have employed similar 
approaches. (Tolman, 1932; Edwards, 19S|4; and Rosenberg, 1956), Fishbein*s approach^ 
is currently the most widely used. ^ 

Random probability sampling was used to survey the external population. To 
determine how NASA technical repoi;ts were read and to help decrease the likelihood 
of Reconstructed logic, respondents were given a NASA technical paper (TP) relate/l 
to'^their discipline or area of research interest*. 

Research Procedures-Questionnaire Design ^ * 

The survey questionnaire, which was jointly prepared by Continental Research 
and the project director, contained 33 closed-ended questions and three open-ended 
ques|:ions. The open-ended questions were listed on a sep'arate sheet and were 
included as a supplement to the questionnaire. The closed-ended questions employed^ 
the attitude spaling technique developed by Fishbein and Ajzen (197S). 

The survey questionnaire was designed to obtain the preferences of readers 
relative to the format ofjNASA technical reports. Specifically, the questions were 
designed to determirfe whirch report components were read and in. what sequence; to 
determine the use of non-NASA, NASA-authored, and Langley-authored STI; and to gather 
data about the technical quality, adequacy of data, format, and the quality of visual 
^ir^^JltMJjms^ In additloji,. certain demographic characteristics of the__3_amp^Le„.p_QpJHr^ 



lations were obtained. 



Each question was pre-tested for relevance and clarity on a randomly selected 
sample of iangley engineers and scientists. The same twenty-six jjuestions were used 
to survey both the internal and external populations. Certain of the seven demo- 
graphic questions were applicable only to one population. The final version^f the 

questionnaire is presented in Appendix A. ^ . 

^ „ __ _ 
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Research Procedure-- Internal Population ' ' * > #^ 

The survey questionnaire was serft to*513 percent) of the -•1,026 engineers 
and scientists assigned to four research directorates (Aeronautics, Electronics,* 
Structures, and Space) at the Langley Research Center. Ev.ery second name on a per- 
sonnel list was selected Jo receive a questionnaire. The questionnaire wa's accom- 
panied by a letter of transmittal signed, by the Director of^.the Langley Research 
Center. A copy of this letter is provided in Appendix B. Approximately 21 days 
after'the initial mailing, approximately 200 follow-up calls were made* Tbis'call 
* served as a thank you^all to those whonad returned their surveys andl as a reminder 
to those who had forgotten. Thirty-nine respondents indicated that they had misplaced 
the survey or had not received it. Each of the 39 was then mailed a new question- 
■ naire packet. People who were not reached by phone* wer^ sent reminder/appreciation 
letters (Appendix C) . ^ • ' ' 

Three hundred seventy^-eight questionnaires- were returned, comprising a response 
rate o£ 74 percent. The questionnaires were edited, coded, and c^jegorized. The 
data were keypunched, entered into a computer, and statistically treated using 
established analytical techniques. The Statistical Package for the Social Sciences 
(SPSS)* was used^for d^ta reduction and aggregation. ^ 

Iflien a sample is randomly selected from a population, the characteristics o'f 
^he population may reasonably be inferred from the attributes of the sample. Such ^ 
inference is then subject to various conventions regarding 'st^^tistical significance. 

'The appropriate application of such conventions tg the primary survey effort is 
called 'iestimation of parameters." The population parameters, in this case a popu- 

^^lation proportion (P) , is estimated from a sample proportion (p) Such estimate^ 
are dependent in part upon sample size. The sample sizes vary f?*^ question to 
question because all respondents did\not answer each question. However, ^ven the . 
general range of sample sizes and the nature of the' sampling distribution of propor- 
tions, it can be stated conservatively that at the' 95 percent c<mfidence level, the 
true population proportion (P) of the internal survey group is w^hin ±5 percent* of 
th^ sample 'pro^port ion (p), that is, P = p ± 5%. ^ ^ 

. Research Procedure--Extemal Population -v . 

Stage 1 of the two-stage procedure involved the development of a sample fram^ of 
academic and industrial engineers and scientists from the membership lists tHF three 
selected professional/technical societies >who agreed tg participate in this study. 
The first society has/a membership of approximately 200,000 electrical and electronic^ 
engineers. A listing of members in the specialized categories ^of aerospace and elec- 
tric systems and instrumentation and measurement was purchased; 

The second socie^^ has approximately 25,000 rneanbers ' from the fie^lds of 

aeronaut ics 'and/o r astrona utics. O nly the names o f those member s listed in_one^ 

of the followijig categories of primary interest were puifchased: structures,^ mate- 
rials, astrodynamics, aircr^t ^iesigiv --f-l^iidrdynamics, aeroacou 



The third society participating in this project has a membership of 
approximately 9,000 persons specializing in the area of geophysics. Qnly names of 
members who specified a primary interest in oceans and atmospheres were purchased. 



SPSS ds a tradename of National Opinion Research Center, Univ>eV^ity of Chicago. 
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A random probability sample was dra\>m from each list, selecting every "nth*^ name 
such that each of the three societies reflected the percentage of LaRC-published^ 
material in each interest area. After selecting the potential respondents (approxi- 
mately 1,400 namesl, telephone numbers were obtained from directory assistance and 
transcribed onto index cards. Members for whom a telephone number could not be r> 
obtained were deleted from the sample. The cards were next alphabetized and com- J\ 
pared to eliminate duplication and to remove any names of Langley employees, iHe 
sample frame which remained (1,000 potential respondents)^ was grouped according to 
time zones to ensure that all resfiondents were called at 'a reasonable hour. Addresses 
were reviewed, and any incomplete cards were deleted, reciting in a final sample 
frame of 896 respondents. 

Stage 2 involved the actual conduct of the survey. A four-step method combining 
the personal touch of telephone^jjvt^rvtisisis-^^^ depth of information possible 
in a mail survey (Dill-ra^,, J978) was used. 

Step 1 - Each person from the final sample frame of 896 usable names was 
'telephoned during the week beginning January 16, 1982, Each individual was asked 
if he/she was a user of NASA technical reports. Those qualifying as report users were 
asked to participate in the evaluation project by completing a mail questionnaire. 
The results of these calls were as follows:^ 

(>7-r0%- — vrii-4-ing to par ticip at e 

) 2.1%- out of town 

7.1% - did not qualify as a NASA report user 
22.7% - never reached (after four tries) 

1.1% - unwilling to participate ~ 

Step 2 - Each of the 600 persons who agreed to participate was mailed a 
questionnaire within 24 hours. With the questionnaire Was sent a skmple^NASA techni- 
cal publication that .reflected the participant's field of interest, a biiief cover 
letter signed by the President of Continental Research thanking the individual for 
'•his/her participation (Appendix D) , and a postage paid reply envelope for use in 
returning the questionnaire. 

Step 3 - Of the 600 potential respondents who were mailed a questionnaire, 
374 received a follow-up phone call approximately one week after his/her initial 
— e-xpresaion-o^f ,wi3rlingne5^ to par-t4^i^te^-in— th^^tu dy. This c^H served as a 
reminder to those who liad not responded and'as a* thank you call to t>iose who had 
returned their completed questionnaire. Those persons not^reached by phone^weje. 
sent letters of. remind er/appreciati>on (Appo.al^x E) , 

Step 4 - Five hundred eleven (over ,85 percent) of the^^questionitaires were 
returned to Continental Research by the cut-off date of March 15, 1982. Seven 
responses were marked **NOT APPLICABLE*^ and were not completed. The remaining 504 
questionnaires were edited, coded, and categorized. Their data were keypunched, 
entered ilito a computer, and statistically treated using established analytical 
techniqyfes. Data reduction and aggregation were accomplished l?y use of the St^tis- 
' tical Package for the Social Sciencds (SPSS)®. 
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Weighted Average Rankings of Sequential Use c 

Weighted average rankings were used to determine the order of use of the 
15 report components (survey topic 1) . The weighted average rankings were obtained 
by assigning weights based on specific order of use. A weight of 15 was assigned 
for components read first, 14 for components read second, de.creasing sequentially to 
1 far components read fifteenth. The weighted ranking was calculated by the formula 
n. w. 

^ ^"^ — - where nj|^ was the number of users reading a component in the "ith** position, 

Wj^ was the weight assigned for the ''ith** position, and n^ was the total number of 
users who read that component in any position. 

Weighted average rankings of order of use were also calculated for survey 
topic 2, which addressed the question of components reviewed to decide whether 
to read a report. The same calculation procedure was employed except that the 
assigned weights ranged from 5 (for read first) decreasing sequentially to 1 
(for read fifth) . 



PRESENTATION OF THE DATA 

« 

The responses to the 14 questions concerned with the NASA technical report 

format were presented as 12 survey topics. Questions 8, 9, and 10 all related to 

placement and use of illustrative material and, for this reason, they were grouped 
into a single survey topic Yor presentation of the data. The responses of both the 
internal population of Langley scientists and engineers and the external population 
of academic and industrial engineers and scientists were given for each question. 
Appendixes F and G present summaries of the internal and external survey results, 
respectively, to the 14 questions. 

In 1982, McCullough, Pinelli, et al., published the results of tl^eir 
survey and analys'is of the technical report. The results are contained in NASA 
TM-83269. The survey and analysis were concerned with th^ organization of the 
technical report (sequential components.) , the language used to convey the informa- 
tion (language components), and the methods used to present the information 
(presentation .components) . Where relevant, the findings from the survey and 
analysis are included after the data on each survey topic. ' 

Demographic Information About Survey Respondent-s ^ ' ^ 

Background data collected as part of the survey revealed that 42 percent of the 

internal re5>pQnd ents and 49 perc ent of tJie external respondents specified a ero- 

nautic^ as their major field of interest. _ The major ^iejds^pf interest of the 
remaining respondents were'^ divided among various scientific/technical disciplines. 

Sixty-nine percent of the internal respondents held positions as^ 
individual contributors within the brganization. Thirty-one percent held positions 
as unit, group, section, branch, or division heads (management). 

Seventy-four percent of the internal respondents and seventy-one percent of the 
external respondents had at least 16 years of professional experience. Forty-one 
percent internally and fifty-five percent externally had been employed for 21 years 
or more. Fewer than 1 percent of both survey groups had less ^than 1 year of pro-" 
fessional experience. 
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A majority (59 percent) of the external respondents were associated with 
industrial organizations, while 17 percent were employed by educational institutions 
When asked about the nature of their professional duties, 37 percent of the external 
group indicated applied research, 20 percent stated technical administration, and 
14 percent specified teaching/academic duties. 

An overwhelming majority (96.5 percent) of the internal respondents used techni 
cal reports in their research. Slightly less (94.9 percent) of the internal^ respon- 
dents used NASA-authored ^technical reports and Langley-authored technical reports in 
their research. 

An overwhelming majority (96.2 percent) of the external respondents used techni 
cal reports in their research.' Slightly less (89.5 percent) of the external respon- 
dents used NASA-authored technical reports while 70 percent used Langley-authored 
technical reports in their research. 
t 

Survey Topic 1: Order in IVhich Users Read or Review Report Cdmponents * 

To determine how NASA reports are read, survex respondents were asked to use 
the NASA technical report provided and to number a list of report components to 
indicate the chronological sequence in which these components are generally read. 
The question as it appeared on the questionnaire is shown in Table C. Tables D and 
E summarize the responses of the internal and external populations, respectively, 
to this question. 



TABLE C 

Text of. Question 1 

The format for a typical NASA technical report appears below. Please 
number IN ORDER the components you generally read/review. (For example, 
if you read the *'ABSTRACr' first, nymber it with a VI.*') Do not number 
those pomponents you skip. 



a. 


Title Page 


b. 


Foreword 


c. 


Preface 


d. 


Table of Contents 


e. 


Summary 


f. 


Introduction 


g- 


Symbol List and Glossary 


h. • 


Description of Research Procedure 


i. 


Results and Discussions- 


j- 


Conclusion 


k. 


Appendixes 


1. 


References 


m. 


Tables 


n. 


Figures 


0. 


" Abstract 



c 
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TABLE D 



Summary: Order in Which Report Components Are Read by Internal Respondents An = 


378) 
















Percentage of participants 


indicating 


respon 


si 












^'"■^'^•-^-.^..^^^^^Re sports e 


Don't 


Read 


■ 

Read 


Read 


Read 


Read 


Read 


Read 


Read 


Read 




Read 


Read 


Read 


Read 


Read 


Component 


read 


1st 


zna 


3rd 


4th 


5th 


6th 


7th 


8th 


9th 


10th 


11th 


12th 


13th 


I4tn 




Title pa^e 


22.2 


75.1 


^1.9 


0.3 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


6.0 


0.3 


0.0 


0.0 


0.3 


Foreword 


84.7 


0.0 


4.0 


2.6 


1.9 


1.3 


0.5 


0.5 


0.3 


0.3 


0.3 


0.3 


0.3 


1 . 1 


1.3 


A Q 
U.O 


Preface 


83.3 


0.0 


1.1 


4.0 


2.9 


1.3 


1.1 


0.8 


0.5 


0.3 




0. 5 


0.8 


0.8 


1.6 


0.8 


Table of contents 


59.0 


0.3 


D . U 


9.3 


10.6 


4.8 


3.2 


1.3 


i.r 


0.8 


0.3 


0.8 


1.1 


1.3 


0.3 


1.1 


Summary 


18. § 


6.1 


30.4 


26.5 


7.1 


' 3.7 


2.9 


1.1 


0.8 > 


0.5 






0.8 


0.0 


0.0 


0.3 


Introduction 


11 J.^^ 


0.3 


6.9 


24.3 


23'. 5 


14.8 


10.1 


5.3 


1.6 


1.1 






0.3 


0.0 


"0,3 


0.0 






•0.0 




1.9 


1.6 










c o 


2 9 


5.3 






1.1 


1.6 


Symbol list and 


52. 1 


0.3 


6.6 


7.1 


4.8 


5.3 


5 . o 










glossary 


























L 




A A 


A 1 


' Description of 


-14.6 


0.0 


0.3 


2.4 


13. S 


13.8 


17.2 


14.0 


1^. ^ 


4 . C 


. 






0.5 


-fj~r\? — 




research procedure 


































Results and 


6.1 


0.0 


1.1 


2.4 


8.5 


22.5 


18.5 


18.0 


9.0 


7.1 


5.0 


0.5 


-0.3 


0.5 


0.5 


0.0 


discussions 


































Conclusion 


1.9 


1.6 


4.8 


15.6 


d9.3 


14.0 


11.6 


8.5'- 


'-8.5 


4.8- 


6.1 


2.1 ' 


0.3 


. 0.5 


0.5 


0.0 


Appendixes 


37.8 


0.0 


0.0 


0.0 


0.0 


0.5 


0.8 


6.3 


8.2 


10.3 


9.3 


1^.2 


'7.4. 


4.2 


1.1 


1.9 


References 


37.3 


0.0 


0.0 


0.8 


0.5^ 


1.1 


2.1 


4.5 


6.9 


9.8 ' 


11.4 


9^ 


9"".0 


3.4 


1.6 


2.1 


Tables 


30.2 


^.0 


0.0 


0.3 


1.6 


2.9 


2.6 


11.1 


13.8 


14.8 


8.5 


7.7 


2.6 


3.2 


0.8^ 


0.0 ' 


Figures 


J5.6 


^ 0.8 


0.5 


4.5 


5.8 


7.7 


13.5 


9.8 


11.1 


9.8 


8.7 


4.2 


4.2 


1.3 


1.9 


^ 0.5 


Abstract 


28.8 


15.3 


43.7 


4.8 


0.8 ■ 


0.3 


0.0 


0.0 


0.3 


0.0 


1.1 


1.6 - 


1.3 


1.3 


0.5 


0.3 
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TAPLE E 

Sununary: Order in Which Report Components' Are Read by External Respondents (n = 504) 



Percentage of participants indicating response 



^*"'*'*"*^^,,*Re'spons e 
Component — 


Don't 
read 


Read 
1st 


Read 
2nd 


Read 
3rd 


Read 
4 th 


Read 
5th 


Read 
6th 


Read 
7th 


Read 
8th 


Read 
9th 


Read 
10th 


Read 
11th 


Read 
12th 


Read 
13th. 


Read 
14th 


Read 
15th 


Title page 


14.1 


81.9 


3.0 


0.0 


0.2 


0.0 


0.0 


0.4 


0.0 


0.0 


0.0 


0.2 


0.0 


0.0 


0.2 


0.0^ 


Foreword 


7a. 6 


0.2 


6.7 


2.6 


0.8 


1.0 


1.4 


1.6 


0.8 


0.2 


0.8 


0.8 


1.4 


0.8 


1.8 


0.6 


Preface 


80.0 


0.0 


'"0.6 


4.0 


3.2 


0.8 


1.0 


1.8 


1.0 


1.2^ 


0.4 


1.2 


0.8 


1.6 


1.8 


0.8 


Table of contents 


51.0 


1.0 


10.3 


10.5 


8.9 


4.8 


■3.0 


1.2 


2.2 


2.0 


0.4 


1.0 


t:.6 


1.0 


0.4 


0.8 


Summary 


9.3 ' 


5.4 


35.1 


28.0 


10. r 


6.5 


1.8 


.1-2 


0.8 


0.4 


0.^ 


0.4 


0.0 


0.4 


-0.0 


0*0 


Introduction 


18.5 


0.6 


4.8 


21.0' 


21.0 


12.1 


9.7 


5.6 


3.6 


2.2 


0.4 


0.2 


0.2 


0.2 


0.0 


0.0 


Symbol list and 
glossary 


. o 


n 9 


U. U 


U . I 


I . I 


4.6 


4.4 


5.2 


4.2 


5.4 


4.6 


4.0 


2.8 


3.8 


1.2 


1.8 


Description of 
research procedure 


25.6 


0.0 


0.4 


2.6 


9.1 


11.3 


14.1 


12.5 


8.1 


5.4 


5.6 


3.2 


1.0 


0.8 


0.4 


0,0 


Results and 
discussions 


10.3 


0.0 


0.4 


4.8 


10.5 


19.0 


17.1 


14.3 


10.9 


6.2 


3.8 


1.6 


0.6 


0.4 


0.2 


0.0 


Conclusion 


^^3.8 ' 


0.2 


2.6 


10.9 


19.4 


19.2 


14.9" 


7.9 


7.3 


6.5 


4.4 


' 2.2 


0.4 


0.2 


0.0 


0.0 


Appendixes 


45.0 


0.0 


0.0 


0.2 


0.2 


0.6 


1.6 


3.8 


3.0 


6.5 


10.7 


11.3 


9.3 


3.8 


1.8 


2.2'^ 


References 


41.5 


0.0 


0.4 


1.0 


1.8 


3.0 


3.6 


5.6 


5.8 


5.0 


7.9 


7.5' 


8.1 


5.0 


2.8 


1.2 


Tables 


35.7 


0.0 


0.2 


0.2 


1.0 


.4.2* 


6.3 


^ 8.5 


10.5 


12.3 


7.3 


6.0 


3.2 


2.2 


V4 


1.0 


Figures* 


24.2 


0.2 


1.4 


4.6 


5.8 


7.9 


9.1 


9.1 


11.1 


8.9 


6.7 


4.2 


2.8 


^1.2 


1.8 


1.0 


Abstract 


34.7 


9.7 


33.5 


8.3 


3.4 


0.8 


1.2 


0.8 


1.0 


1.0 


0.8 


0.6 


1.4 


0.2 


pU 


2.2 
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The,.data in Tables D and E were used to construct Table F which shows, for 
each component, the percentages of survey respondents who indicated they read that 
component at some stage in the use sequence. The report components are listed- in 
Table F in descending frequency of use. 

For both internal and external populations, the component read by the highest 
percentage of readers was the conclusion. Ninety-eight percent of Langley respon- 
dents and ninety-six percent of academic/industrial respondents indicated they read 
the conclusion. Other components read by more than 80 percent of both groups were 
the results and discussion, the summary, and the introduction. 

On the 6ther hand, certain components were read by very few respondents in 
either survey group. The foreword and preface had very low usage rates. Only 
15 to 21 percent of the respondents indicated that they read these components, (With 
the exception of NASA Conference Publications, Reference Publications, and Special 
Publications, NASA Technical Papers and Technical Memorandums generally do not includ 
a foreword or preface,) Other components read by less than half of the respondents 
were the table of contents and the symbol list/glossary, 

TABLE F ' 

Summary: Percentage of Survey Respondents Who Read Various Report Components 



/ 



Internal survey (n= 3 7& )- 



Component 



Conclusion 

Results and 
discussion 

Introduction 

Description 
of research 
procedure- 

Figures : 

Si 



Titre-^age 
Abstract 



Tables 

References 

Appendixes 

Symbol list 
and glossary 

Table of 
contents 

Preface 

Foreword 



Percentage 
who read 



98 

94 

89 

85 
84 
Si 
78 
71 



63 
62 

48 

41 
17 
15 



F xt em a 1 survey (n = S 04 ) 



Component . 



Conclusion 

Summary 

Results and 
discussion 

Title page 

Introduction 

Figures 

Description 
- ^-Hre^arc4v. 
procedure 

Abstract 



.1^ ^ 



Tables 

Refigrences 

Appendixes 

Table of 
contents 

Symbol list 
and glossary 

Foreword 

Preface 



Percentage 
who read 



96 
91 

90 
86 
82 
76 



74 
65 



59 
55 

49 

44 
21 
20 



rnmhined .surveys (n= 882) 



Component 



Conclusion 

Results and 
discussion 

Summary 

Introduction 

Title page 

Figures 

Description 
— of >.researcJi 
procedure 

Abstract 



labies * 

References 

Appendixes 

Symbol list 
^and glossary 

Table of 
contents 

Foreword * 

Preface 



Percentage 
who read 



97 

91 
87 
85 
82 
79 

79 
68 



"67~ 

60 
58 

46 

46 
19 
19 



23 

5 



To clarify sequence of use of report components, a weighted average ranking was 
calculated and is presented in Table G. IVhen both surveys were combined, the result- 
ing mean sequence for the first six components read was title page, summary, abstract, 
introduction, table of coritents, and conclusion. IVhen examined separately, the 
internal and external survey groups showed very similar overall use patterns with a 
"few narrow ^variations in sequential positions. For example, while both surveys groups 
read the title page first, internal respondents indicated they read the abstract 
second and the summary third; whereas, external respondents read the summary second 
and the abstract third. Both groups named the references and appendixes as last in 
their reading sequences. 

^ > 

Although the abstract appears on the last page of NASA reports, this component 
was read by a clear majority of users (71 percent internally and 65 percent exter- 
nally). Moreover, the abstract was most commonly the second or third report compo- 
nent read by users. 

The McCullough and Pinelli study (1982), while not addressing the sequence of 
use by readers, was concerned with which components were actually present in a 
survey of 99 reports and with which components were recommended for inclusion in 
technical reports by selected textbooks and style manuals/publications guides. 

The survey reports showed wide variation in the number, kind, and placement of 
sequential components. The 99 reports surveyed used 96 different components. Only 
five- compunenls (cover, title page, table of contents, introduction, and appendixesj 
were common to half or more of the reports; however, strong agreement (82 percent or 
^^more) existed in regard to placement of these five components as front, body, or 
back matter. 

The six style manuals and publications guides were not unified in the number 
and names of components recommended for inclusion in technical reports. Sixteen of 
twenty- four components were recommended by a majority of these sources; however, 
unanimous agreement for inclusion existed for only two components, the introduction 
and appendixes. The style manuals and publications guides were even more divided 
in the recommended sequence of the report components. 

Textbooks showed the greatest g^reement on which components should be con- 
sidered for inclusion in technical reports. All six texts consulted recommended 
the following seVei) components: mema/letter of transmittal, title page, abstract, 

J^PXtt^s^^U^t^JDE-iUus^a^ioi^ ^Purther, a 

consensus for inclusion existed for 16*of 20 components mentioned by one or more 
texts. 



Tilt; Lhrec soux'Ces uyed in the McCulloQgh and Pineiii study (survey reports, 
style manuals/publications guides, and textbooks) were compared to produce a list of > 
components recommended for inclusion by 50 percent or more of any of the three 
sources. This comparison, shown in Table H, was presented to indicate whether each 
source, as a consensus, advocated that a particular component should be included as 
a structural component of a technical report. Components recommended by NASA were 
included for comparison. The survey reports represented the limiting factor in that, 
as mentioned previously, only five components were common to more than half of the 
reports. Considering only the textbooks and style manuals, agreement existed on 12 
components: the cover, title page, abstract, contents, list of figures/illustrations, 
list of symbols, introduction, t^ody (text), bibliography, references, appendix, and 
glossary. The NASA Publications Manual discussed 10 of these 12, omitting only the 
list of figures/illustrations and the glossary. 

ERLC 
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TABLE G 

Weighted Average Ranking: Order in \^ich Report Components Are Read 



Internal survey 



Component 



Title page 

Abstract 

Summary 

Introduction 

Table of^ 
contents 

Conclusion 

Foreword 

Results and 
discussion 



n 



294 
269 
307 

336^ 

155 
371,, 
58 

355 



Weighted 
avg. rank* 



14.9 
13.2 
12.9 
11.6 

10.9 
'10.4 
^9.9 

9.6 



External survey 



Component 



Title page 

Summary ' 

Abstract 

Introduction 

Table of 
contents 

Conclusion 

Foreword 

Results and 
discussion 



Descriplion — 
of research 
procedure 

Figures 

Preface 

Tables 

Symbol list 
% glossary 

References 

Appendixes 



n 



433 
457 
329 
411 

247 
485 
108 

452 



Weighted 
avg . rank"" 



14.9 
12.9 
12.6 
11.4 

11.1 
10.3 
9.7' 

9.7 



Combined surveys 



Component 



Title page 

Summary 

Abstract 

Introduction 

Table of 
contents 

Conclusion 

Foreword 

Resuft^ and 
discussion 



D e sciM L^Mon — 
of research 
procedure 

Preface 

Figures 

Symbpl list 
§ glossary 

Tables 

References 

Appendixes 



n 



' Weighted 
avg. rank"^ 



727 
7T64 
598 
747 

402 
856 
166 



14.9 
12.9 
12.9 
11.5 

11.0 
10.4 

"9.8 

,9.6 



Description 
of research 
procedure 

Preface 

Figures 

Symbol list 
§ glossary 

Tables 

References 

Appendixes 



323 
63 
319 

181 
264 
237 
235 



9.5 
9.2 
8.4' 

7.9 
7.2 
6.1 
6.0 



375 
382 
101 
324 

223 
295 
277 



.9.2 
8.5 
8.5 
7.3 

7.2 
6.5 
5.6 



698 
164 
701 

404 
588 
532 
512 



9.4 
8.8 
8.5 

7.5 
7.3 
6.3 
5.8 



♦Highest number indicates component was read first; lowest number indicates component was read last 
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TABLE H 




• 


Components Included by Half or More of Each 


Source (McCul lough 




and Pinelli, 1982 > 










Source 




- 


Component 


Xr^ciuded oy a 
majority of 
survey reports 


Included by 
half or more of 
style manuals 

and guides 


Included by 
half or more of 
textbooks 


Listed by 
NASA 
Publications 
Minual 


\ 

/ 




Cover 


Yes 


Yes 


Yes 


Yes 






Memo/Letter of 


No 


No 


Yes 


No 


- 




transmittal 














Title page 
Abstract 


Yes 


Yes 


Yes 


Yes 






No 


Yes 


Yes 


Yes 






Contents 


Yes 


Yes 


^Yes 


Yes' 






List of figures/ 


No 


Yes 


' Yes 


No 






illustrations 














List of symbols 


No 


Yes. 


Yes 


Yes 






— tntroduction 




Tr — . — 
























Summary 


No 


No 


Yes 


Yes 






Conclusions 


No 


No 


Yes 


Yes 






Recommendations 


- - No 


• No 


Yes 


No . 






Body (Text) 


No 


Yes 


Yes 


Yes 






^ Discussion 


No 


No 


Yes 


Yes 






Bibliography 


No 


Yes 


Yes , 


Yes 






References 


No 


Yes 


Yes 


Yes 






Appendix 


Yes 


Yes 


Yes 


. Yes 






Foreword 


No 


Yes 


No 


No 






Preface 


No 


Yes 


No 


Yes 






List of tables 


No 


Yes 


No 


No 






Glossary 


No 


Yes 


Yes 


Np 






Index 


No 


Yes 


No 


No 





Survey Topic 2: Components Reviewed or Read to Determine Whether to Read the Full 
Report 

The respondent^ were asked tS indicate which components (up to five) listed in 
question 1 (see Table C) "were used to decide whether to read*th^ report. Respondents 
were asked to indicate the order in which these components were read. Table I shows 
the question contained in the questionnaire. Summaries of the results from the 
internal and exte|:nal respondents are given in Tables J and K, respectively. 
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TABLE I 

r 

*• , * . Text of Question 2 

Referring to the li^ above, which NASA report components do you review 
or read to determine if you will actually READ THE REPORT? (Please 
select letter from list above in t|ie order you review them.) 



review 
first ' 



review 
second 



review 
third 



review 
fourth 



review 
fifth 



TABLE J 

Summary: Components Used by Internal Respondents tQjJ)ecide Whether to 

Read a Report (n = -378) 



^""""^^-^^fee spon s e 


Percentage' of participants indicating responses^"* 


Component ^^^^.^^^^ 




Kev JlCW 


rvc V JL c *v 


r\c V ± cw 


Rpvi pw 
rvc V JL 


Summat ion 


1st 


2nd 


3rd 


.4th 


5th 


review 1st - 5th 


Title page 


47.6 


0.0 


0.3 


0.0 . 


0.0 


47.9 


Foreword 


0.0 


2.6 


0.8 


0.3 


1.1 


4.8 


Preface 


■ 0.0 


.0.3 


0.5 


0.8 


0.8 


2.4 


Table of contents 


0.3 


3.2 


6-6 - 


3.4 


1.3 


14-. 8 


Summary * 


17.2 


28.3 


19.0 


3.2 


' -1.1 


68.8 


Introduction 


0.8 


11.1 


14.3 


11.9 


8.5 


46.6 


Symbol list and 
glossary 


0.0 


0.3 


' ,0.5 


0.0 


0.5 


1.3 


Description of 

research procedure 


0.0 . 


0.8 


3.4 


^.0 


4.2 


12.4 


Results and 














discussions 


0.3 


1.1. 


5.3 


9.0 


8.7 


24.4 


Conclusion 


2.6" 


16.1 


23.3 


16.7 , 


8.5 

078—' 


67.2 

' r7&^ 


Appendixes 


. U.O 


. 0.0 — 


070 — 


078— 






References 


0.0 • 


0.3 


0.8 


1.6 


1.3 


4.0 ■ 


Tables 


0.0 


0.0 


0.5 


a.. 


, 1.9 


3.5 


Figures 


0.8 


1.9 ' 


■ 7.7 


7.9 


5.3 


\ 23.6 


Abstract 


29.1 


31.2 


•2.i 


0.8 


0.0 


63.2 


None of the above 














components 


1.3 


2.9 


14.8 


38.6 


56.1 
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TABLE K 

Summary: (Components Used by Extemal'^Respondents tV. Decide WhetTrer^-to 

Read a* Report (n = S04) 



e s pon S e 
Component ^'^'^^^^ 


Percentage of participants indicating responses 


Review 
Jst 


Review 
2nd 


Review 
3rd , 


Review 
4th 


Review 
5th 


Summation 
review 1st - 5th 


Title page 


55.6 


0.8 


0.2 


0.2 


0.2 


&7.0 


^Foreword 




3.2 


.0.8 


i 

0.8 , 


0.6 


,5.6 


Preface 


0.0 


0.6 


0.6 


l.(y 


0:0 


2.8 


Table of cdrvtents 


0.6 


6.7 


6.7 


4.6 


2.4 • 


^ 21.0 


Summary 


16.9 


31.5 ' 


19.6 


■ 5.2 


3.8 


^77\0 


Introduction * 


1.2 


7.7 


15.1 


8.9\ 


4.2 


■ 37.-1 


Symbol list and 
glossary 


" o:o I 


0.2 




0.4 


0.2 


0.8 


Description of 

reseairch procedur©*^ 


0,0 


0.6 


2.0 


3.4 


' 5.4 


11.4 


Results and 
^ discussions 


0.4 


. . 3.4 


6.7 


8. J 


6.3 


24.9 


Conclusion 


liO 


9.7' ^ 


1 19^6 


' "f7.3 


10:5 


58.1 ■ 


Appendixes 


Q.O 


0.0' 


I 0.0 ^ 


0.8 


, 0.4 


1.2 


I^efef encei . 
Tables 


O.d, 
0.0 


0.6 
0.0 


0.4 " 
1.8 


1.0 
1.2 


2.5 
3.0 


5.1 
6.0 


Figures 


' ■ 0,6 


3.2 


5.0 


6.5 \ 


4.6 


19.9 


Abstract 


21.0 


27.4 


6.0 


2.0 


0.2 


. 56.6 


None of the above 
components 


2.0^ 


4.4 

V 


15.5 


38.1 


55.8 
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Table L lists the five components most frequently used' by survey respondents 
in reviewing reports for' possible reading and the percentage use by each group. 
Respondents from both groups indicated the summary, conclusion, abstr^act, title page, 
and introduction (listed in decreasing frequency of use). as the components most 
often reviewed to determine if a .report would actually be read. The. summary was the " 
component utilized by the highest percentage of survey respondents as a screening 
tool. Sixty-nine percent pf the internal and seventy-seven percent of the external 
respondent indicated that the summary was used as one of the screening components. 



TABLE L 



Components ^tost-Gommon-l-y-Used- 
Review/Read Reports 



Component 


J 

Percentage of respondents indicating 
use of a report component 


Internal survey 
n = 378 


External survey 
n = 504 


Summary 




77 


Cbnclusion 
r 


67 4 


58 


Abstract 


63 


57 


Title page 


48. 


57 


Introduction 


47 


37 



Table M gives a weighted average ranking for order of use of the five components 
most frequently reviewed in deciding whether to read a report. .This table shows that 
the most (jommon sequence used by the combined surveys was: title page, abstract, 
summary, introduction, and conclusion. The use pattern for both internal and exter- 
nal group$> 'was j;|^e same as that for the combined surveys except that the internal 
users read the'^cohclusion (fourth position) before the introduction (fifth position). 
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TABLE M 



Weighted Average Ranking: Order in Which Components are Reviewed in Deciding Whether 



Xo~T^ead a Report 





Interr 




lal surv( 


5y 


External survey 


Combined surveys 




Component 


n 


Weighted 
avg* rank* 


Component 


n 


Weighted 
avg. rank* 


Component 


n 


(Weighted 
avg . rank* 


o 


Title page 


181 


4.99 


Title page « 


287 


4.95 


Title page 


468 . 


•4.97 




Abstract 


239 

> 


4.40 


Abstract 


288 


4.17 


Abstract 


527 


4.28 




Summary 


260 


3.83 


Summary 


388 


3.68 


Summary 


648 


3.74 • 


o 


Conclusion 
Introduction 


254 


2.82 


Introduction 


187 


2.81 


Introduction 


363 


2.. 73 


4 


« 176 



2.65 


Conclusion 


293 


2.54 


Conclusion 


547 


2.67 



♦Highest number indidates component was read 'first; lowest number indicates component was read last 




survey Topic 3: Report Components Which Cotild Be Deleted 

The respondents were asked to list any NASA report components (up to fdve) 
which could be deleted. Table N .shows question 3 as it appeared on the questionnaire, 
and TableTJ contains a summary of the results tabulated for this question. 

TABLE iJ* 

Text of Question 3 * t 

In your opinion, 'which of the above listed (in q. 1) report 
components could be deleted? 



TABLE 0 ' , ' 

Summary: Opinions of Resjpondents Conce rning Whic h Repo rt Compo nents 

Could Be Deleted 





^. Percentage of resjjoridents suggesting deletion 


Component 


Internal respondents 
n*=' 378 


External re<?nnndpni* <; 
n = 504 , 


Title page ^ 


.2.6- 


1.8 


Foreword 


"69.0 


53.0 


Preface 


67.5 


54.2 


Table of contents 


24.1 


10.3 


Summary 


./ 13.0 


• . 7.3 


Introduction 


1.9 


l.fr 


Symbol list and 

glossary ^ 


,5.6 


'6.2 


Research procedure ' 




1.0 


Results and discussions 


0.0 


0.2 


Conclusion 


0.5 


0.8 


Appendixes 


1.6 


2.8 


References 


0.0 


1.0 


Tables 


0.0 


0.2 


Figures 


0'.3 


0.0 


Abstract , 


11.4 


12.5 


None 


22.0 


34.3 



The^most dispensable components w6re thought to be the foreword and the 
preface by both survey groups. Sixty-nine percent of the internal respondents and 
fifty-three percent of the external respondents suggested deleting the foreword. 
Sixty-eight percent of Langley respondents and fifty-four percent of the academic/ 
industrial respondents named the preface as a component which could be deleted. 

Twenty-fout percent of the internal' respondents suggested deleting the table 
of contents. Only 10 percent of the external respondents concurred vmh that 
opinion. Twenty-two percent of the internal and thirty-four percent oft the 
external respondents indicated th^at no components should be deleted. ) 
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Survey Topic 4: Desirability of a Table of Contents 

The respondents were asked a question concerning the need for and/or desirabil- 
ity of -a table of contents in NASA technical reports, regardless of the repcJrt's 
length* Table P shows the question and possible responses as contained in the 
questionnaire. Summaries of the results from the internal and external respondents 
are given in Table Q. 

TABLE P . 

Text of<Juestion 4 

// • 

Should ALL technical reports have a Table of Contents ^ 
(x- egai ' dless pf length of' report-^ -_ 

Yes, all should. No, only long reports need it. 

TABLE Q 

Summary: Opinions of Respondents Concerning the Desirability of a,^ 
— Table of Contents ^ — — 



Response 


Percentage 


Internal respondents 
n = 376^ 


External respondents 
n = 503 


Yes, all should-^- 

No, only long reports 
need it 


22.1 

77.9 


43.5 
A 56 . S 



ERIC 



Only 22 percent of the Langley respondents indicated that all NASA reports . 
(regardless of length) should contain a table of contents; however, of the external 
respondents, 44 percent -expressed the need for a table of contents in all NASA 
reports. Thus, while the majority opinion of both internal and external respondents 
was that only long reports n^ed a table of contents, non-NASA respondents expressed 
the desire for this component in all NASA reports twice as often as the NASA Langley 
respondents. 

McCullough and Pinelli (1982) found that 70 of the 99 reports they analyzed 
contained a tabl^ of contents. In every case, the table of contents was located as 
front matter. ^ All six of the technical writing and editing textbooks and five of 
the six publications guides and style manuals consulted in the ^tudy recommended 
that technical reports contain a table of contents. 

Suyvey Topic 5: Desirability of a Summary in' Addition to an Abstract ^ 

The respondents were asked a question concemipg the need for a summary 
(app^ing in the front) in addition to the abstract, which appears as back matter 
on the COSATI page -of NASA reports. " Table R contains the question and pos/ible 
responses as" contained in the questionnaire. Summaries of the results obtained 
from the internal and external respondents are given in TibleS. 
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TABLE R , 
^ Text of Question 5 

Giv^en that NASA reports contain brief abstracts (about 
r"2.00 words) in the back, do you also need the more 
.detailed summary section^ (which appears in the front)? 

Yes, include a summary, too, No, don't bother with it 



TABLE S 



Summary: Opinions of Respondents Concerning the Desirability of 
a Summary iilTAaaiYion to an Abstract - 



^ Response 


Percentage 


Internal respondents 
n = 374 


External respondents 
n = 496 








Yes, include a sutoiary, 
too 

No, don't bother with it 


51.1 
48.9 

* 


68.7 
31.3 



The internal respondents were fairly evenly divided about whether the more 
detailed summary should be included in NASA technical i;eports in addition to the 
abstract. (A slight majority (51 percent) favored inclusion of both components.) 
Among external respondents, however, 69 percent indicated that NASA reports should 
have a summary in addition- to an abstract. 

In the McCul lough ana Pinelli study (1982), 39 of the 99 technical reports 
analyzed contained an abstract, and 30 of the 99 contained a summary.. Data were 
not collected on how many of these reports contained both components and how many 
contained only one of the two. In those reports containing an abstract, it was 
located as front matter in the majority of cases (85 percent), men present, 
the summary tended to be located as body matter most commonly (5^ percent of the 
reports), followed by front matter (37 percent), and back matter (10 percent). All . 
six textbooks recommended inclusion of an abstract; three of the six also recom- 
mended that a summary be used. The style manuals and publications guides were less 
uniform concerning both £on2)onents. Three of the six sources recommended an ab- 
stract, ^urohly one rej;:ommended a Nummary. All "style manual$7publications guides^ 
placed the abstract and summary components in the front matter of the report. No 
data were obtained from the textbooks on the order, of these two components. 

Survey Topic 6: Location Jf^the Definition of Symbols and Glossary of Terms 

Survey respondents were asked to indicate where in a NASA report the definition 
of symbols and glossary of terms components should appear. Table T contains the 
question and possible responses as worded 'in the questionnaire. Summaries of the 
results from the internal and external respondents are given in Table U. 
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TABLE T 

Text of Question 6 

Where in a NASA technical report should a Definition of 
Symbols and Glossary of Terms appear^ (check only one) 

' N ear front of report 
Wear back of report ' 

N^ar front of report AND where symbol or term appears 

Near back of report AND where symbol or term appears 

NO Symbol List or Glossary of Terms needed; just 

define symbol or term wfiere it appears in report 

4= ^FABLE-U ^ 



Summary: ^ Opinion-s of Respondents Concerning the Location of the 
Definition of Symbols and Glossary of Terms 





Percentage 


Response 


Internal respondents 
n = 375 


External respondents 

n = 501 
V, . 


Near front of report - ^ 


48.8 


47.1;. 


Near back of r^eport 


12.3 


15.0 


Near front of report AND where 
symbol or term appears 


20.5 


* 

16.2 


Near back of report AND where 
symbol or term appears* 


8.3 


9.2 


NO symbol list or glossary of 
terms needed; just define 
symbol or term where it 
appears in report 


10.1 


"12.6 



The response pattern from the internal and external respondents was siMlar. 
In both cases, the largest percentage (49 percent internally; 47 pfercent extSarnally) 
'chose the response, "near front of report." The second highest percentage of both 
^toupsj:2],_percent J.nternalljr;_16 jpercent externally) chose "near front of report 
AND where symbolor term appears." Thus, when results from these two respon-ses were 
combined., a preference (69 percent among internal respondents ; '^jfeS percent among 
external respondents) was evident for the definition of symbols and glossary of terms 
to be located near the front of reports as opposed to being located as back matter. 

In the McCullough and.Pinelli sfudy (1982), the list of symbols and glossary 
were considered separately. , Eighteen percent of the technical reports analyzed , 
contained a list of symbols. Placement statistics were: front matter, 61 percent; 
body matter, 6 percent! and back matter, 33 percent. Twenty-three of the ninety- 
nine reports had a glossary. 'There was a strong consensus of practice to locate 
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the glossary as back matter (87 percent). Glossaries appeared as front matter in 
only 9 percent and as body matter in only 4 perceht of their oc<iurrences. ^ 

^ 

Four of the six style manuals/publications guides consulted by McCullough and 
Pinelli recommended that a glossary be included in technical reports.* Three style 
manuals/publications guides, all of which had recommended a glossary, also recom- 
mended a list of symbols and/or abbreviations. The list 'of symbols was treated as 
front matter by all three style manuals/publications guides. The glossary was 
treated as back matter by all four manuals. Of the six textbooks used in this 
study, three suggested inclusion of 'a list of symbols, ani. three suggested inclu- 
sion of a glossary. Two of the three books recommending a glossary had also recom- 
mended a list of symbols. No data were obtained from the textbooks regarding . 
placement of these two components. 



The NASA Publications Manual .placed the symbols list as body matter following 
the introduction rather than as front or back matter. This location was viewed by 
several sources to interrupt the continuity from the introduction to the rest of the 
text and to be less accessible as a reference tool to the reader. 

Survey Topic 7: When Appendix Material Is Read 

Survey respondents were aiked a question concerning when they read appendix 
material — before^ with, or after the text. Table V^contains the question and 
possible responses, as they were worded in the quest ionriaire . Summaries of the 
results from the internal and external respondents are given in Table W. 

TABLE 

Text of Question 7 , * . ^ 

When Apj[)endixes appear in a NASA technical report, when 
do you usually read them? (check only one) . ^ 

' Before the text • ? 

With the text 



After the text 



TABLE W 



Summary: When Respondents Read Appendix Material 



Response 


Percentage 


Internal respondents 
^ n = 373 


External respondents 
n = 498 


Before the, text ^ 


1.6 


2.0 


With the text > ' * 


22.0 


20.5 


After the text \ / 


76.4 


77'. 5 



The internal and exterrial responses were very similar. A strong majority 
(77 percent internally; 78 percent externally) indicated that the appendixes were 
read after the text. TwentT'-two percent of internal respondents and twenty-one 
percent of external respondents, stated that the appendixes were read with the text. 
Only 2 percent of each population indicated that the appendix material was read 
prior to reading the text 
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Survey Topic 8; Location and Use of Illustrative Material 



Internal and external respondents were asked three questions concerning the 
location and use of illustrative material (such as tables, graphs, and photographs) 
in NASA technical reports. Table X contains the first of these questions and the 
possible responses. A summary of the results from the internal and external respon- 
dents is presented in Table Y. ^ ... 

TABLE X 

Text of Question 8 ' ^ 

Where in a NASA technical report should the illustrative 
mat^rir a 1 ( t ^ablesT— graphsv^phot^^graphsrT^t x * ) a ppeay? 

^Integrated with text 

^ ^^^Separate from text; at ei)d of report 



TABt^E Y 

Summary:, Opinions of Respondents Concerning Integration of Illustrative 
Material as Opposed to Grouping It At the End of the {Report 



Response 


Percentage 


Internal respondents 
n = 375 


External respondents 
n = 500 , ^ 


Integrated with text 

"Separate from textj; at 
, end of report 


. 80.3 
S9.7 


* 80.2 
19.8 



The survey results showed that 80 percent of both Langley and academic/industrial 
engineers and scientists preferred that illustrative material be integr^ed with the 
text as opposed to being grouped in the back matter. 

The majority of the prescriptive sources and experimental/ theoretical literature 
reviewecfby McCullough and Pinelli (1982) recommended that figures and tables be 
integrated with the text. Eighty-two percent of the technical reports analyzed in 
that study had figures integrated into the text. Seventy-eight percent had tables 
integrated in the text. Figure 3 summarizes the findings of that study in -regard to 
this topic. Average values were relatively similar among the various document 
categories except that figures were integrate^d in less than 60 percent of government 
reports. , . ' 

The NASA Publications Manual stated that tab;ies and figures can be either inte- 
grated with the tex^ as body matter or grouped together in the back mattei* after the 
appendixes and'^f^eferenceS . Examination of several NASA reports indicated that the 
lattea? treatment was often employed. Prescriptive sources and the survey reports 
were in strong agreement that figures and tables should be included in the text as 
soon as possible after first mentioned. 
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Figure 3. Percentage of documents analyzed by McCullough and Pinelli 
(1982) with visuals integrated in text 



Table Z contains the second of the three questions related to user preferences 
concerning the placement of illustrative material. This question was addressed only 
to those participants who said in response to' the previous question that illustrative 
material should be integrated with the text. The question was concerned with deter- 
mining if a limit exists on thg amount of visual matter than can be integrated withoOt 
interrupting the reader. Summaries of the internal and external responses are pre- 
sented in Table AA. , ' 

TABLE Z 
Text of Question 9 

J' 

If illustrative material shduld be integrated, is there a point at 
which the illustrative material interrupts your reading? (check 
only one) 

Yes, when there are two pages of illustrative ijiaterial for every 

page of text . i 

Yes^, when there are three pages of illustrative material for 

' ' — every page of text ^ 

Yes, when there are four or more pages of illustrative material 

for every page ,of text 
No, I always prefer to haye illustrative material integrated in 

text 
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^ ' TABLE AA 

-Summary: Opinions of Respondents Concerning the Amount of Illustrative 
Material That Can Be Integrated With the Text Without Interrupting the Reader 



Response 



Yes, when there are two pages 
of illustrative material for 
every-^c^e-o f tex t — 

Yes, when there are three pages 
of illustrative material far 
ev^ry page ofiftext 

Yes, when there are four or more 
pages of illustrative material 
for every page- of text 

No, I always prefer to have 

illustrative material integrated 
in text 

L 



Of the Langley engineers and scientists, 49 piercent indicated that Integration 
of tables and figures did not interrupt their reading no matter how much illustrative 
material the report contained. The corresponding figure for academic and industrial 
engineers and scientists was 53 percent. The illustrative-page/text-page ratio which 
interrupted reading was placed at two by 26 percent of internal respondents and 
19 percent of external respondents; at three by 17 percent of internal respondents 
and 20 percent of external respondents; and at four or more ^ by 8 percent of both 
groups. ' ' ^ 

The.McCullough and Pinelli^^study (1982) did not compile infarmation from 
prescriptive sources on the amd<S^t of visual materials that can be 'integrated into 
the text without interrupting reading. The study did, however, present data on 

.average table-to-page and figure- to -page ratios for 50" techi^ical reports. The mean 
table-to-page ratio was 0.16, with arrange of 0 to 0.66. The average figure-to-page 
ratio was 0.66, with a range of 0 t6 2.03. Summing the means of the two ratios yields 

•a visual -page/text-page- ratio of 0,82. Only at the very upper range of the ratios did 
the amount of visual material in proportion to text material approach the point -where ^ 
somfe respondents indicated interruption of reading. 

The third question concerning illustrative material dealt with when this 

* material was read. Table BB contains the question and possible responses as worded on 

the questionnaire. Summaries of the internal and^ external responses are presented 
in Table CC. - ' " , , 



/ 




Percentage 



Internal 
respondents 
n = 298 



25.5 



17.1 



8.1 



49.3 



External 
respondents 

n = 399 




TABLE BB 

Text of Question 10 t 

When do you usually read illustrative material? 
(check only one) 



JBefore the text 
JVith the text 
After the text 



TABLE CC / 
Summary: When Respondents Read Illustrative Material 



Response 

f ♦ 


^ Percentage 


Internal respondents 
n = 377 ^ 


External respondents 
n = 500 . 


Before the text 


14*7 


19.0 


With the text 


82*6 


77.2 


After the text 


. -2.1 . 


3.8 



Most respondents (83 percent internally; 77 percent externally) indicated that 
the, illustrative material was read With the text. Some respondents (15 percent 
internally; 19 percent externally) indicated that the illustrative material was read 
be^bre the text. Only a few respondents (3 percent internally; 4 percent externally) 
indicated that the illustrative material was read after the text. 

" Survey Topic 9: Format of Reference Citations 

The respondents vere asked to specify their preference between two formats 
for reference' citations in NASA technical reports. Table DD lists Uhe survey ques- 
tion and the response options. Summaries of the internal and external respondents' 
responses ar.e presented in Table EEv 



FRir 



39 



52 



1 



TABLE 'DD 



Text of Question 11 



Which of the following two forms of reference, citation 
dp you prefer for technical report s?<) (check one) 

^Clted in' text by author/year (e.g., Jones 1978) 

with an alphabetical list in back of report 
Cited in text by number (e.g., r^eference 16) with 

a numbered list in bacirof report 

— ■ -^^-^ ^ - 



TAPLE EE 

- Summary: Preferences of Respondents Conceiliing the Format of ^ 

Reference Citations 





— ~r 


J 

Percentage 


> 


Response y ' * 


Internal * 
respondents 
n = -371 


External 
respondents 
n-= 494 




Cited in text by author/year 
(e.g., Jone? 1978) with an 
alphabetical list in back 
of report 


^ 35.8 


36.0 




Cited in text by number (e*g., 
reference 16) with a numbered 
list in back of report 


64.2 






y t . 







Sixty-four percent of the scientists and engineers preferred references in the 
text to be cited by number rather than by author and date. The percentage was 
essentially the same for both internal and extemal populations. 

. Survey Topic 10: Specification of Units for Dimensional Values " ^ 

Question 12 asked the respondents to-specify their preferences concerning the 
use of the International Sy^JtSffi (S.I.) units and/or U.S. Customary units for - 
dimejisional valued in reports. Table FF contains the survey question and the ^ • 
response options.. Table GG contains the results of the, survey responses concerning 
this question^ v 
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TABLE FF 
t of/Qjiestion 1-2 



'How do ymi^ef9¥^to have dimensional values 
specified in rep^brts? (check only one^ ' ' 

The International System (S.I.) units ' 

(e.g.^ meter, kilogram)^ 

y.S, Customary' units (e.g. ,^ foot ,^ poMnd) 

^•'''^i^s^ jSrn units with U.S. Custqmary units in 
parentheses ' ^ 
U.S . Customary units with S. T. ui^i ts in ^' 
parentheses' 



Summary : 




LE GG 

Preferences of RespondentsvConceming Units 'for 
Dimensional Values 



I^esponse / ^ 
a f ^ 


Percent a^^ ; * ^ 


Intemal 
respondents 
n'- 374 


External 
resp'ondents 
n = 498 , • 


ThOs^Internatieriill (S.I.) 
units (e.g., mVter,) kilogram) 


«^ 

22.5 ■ . , 


25.3' 


U.Sj^<lustomafy unVts, (e.g.^ foot, 
pound) ' \ 

\ ^ 


29.7 


17.9 ' 


S.I. units with U.S. \ustomary 
uilits in parentheses 

U.S. Customary unlt^ith S.I. f*^^ 
1 uni't^ in parentheses ^ ) 


25.7 

^ . 22.2 _ 


24.1 

' . - 32.7 



J 
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There was no overall .agreement ^ong -either\survey group as to/fiow 
dimensional values should b^Vs^ecified i| NASA technical reports^^^ The responses 
"were approximately' equally divided among th^^bur possible gptioifs Except tha$, of 
the academic 'and industrial engineers and scientists, 33 percefit preferred U.S. 
Cus|:omaiy units with S.1% jjf|ts^in parenthesfe^t while only 18 percent p;:eferred 
U.S'. Customary units al^^jfeT^ " -u 

Survey Topic 11: Column Layout and 'Right Margin^ Treatment 

The respondents were a^ked to state th^ij preferences concerning one or two 
column layouts and ragged or justified right margins. Table HH contains the ques-^ 
tion as it appeared inj^iie questionnaire. Table II summarizes the results of the 
internal and external surveys. , ' 

' ■ 41 • 
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TABLE HH 

Text of Question 13 

Which of the following forms of layout do you prefer 
for technical repjorts? (check only one) 

^ One coluron; ragged right margin 

O ne column; justified right margin 

Two columns;' ragged right margin 

Two columns; justified right margin 



Summary: 



' TABLE II 

Preferences of Respondents Concerning Column Layout and 
Right Margin Treatment 





Percentage 


Response 


Internal 
respondents 

li ^ 365 


External 
respondents 
n = 483 


One column; ragged right 
margin 


53.4 






55.3 


One column; justified 
right margin ^ 


' 24.9 






■ 24.4 


Two columns; ragged right 
margin 


8.8 






5.6 


Two columns; justified ( 
right margin 


12.9 


o 




14.7 






% ■ 





Over half of both internal (54 percent) and external (55 percent) re^ondents 
preferred the one column, raggeds|right margin format. The. one column, justified 
-Fight-margin was^-pr-efer-r-ed~by-4:he~second-largest pox^tion ^of hot^_^roups (2^5 _p_ercent 
internally; 24 percent externally). Thus, the one column format was preferred by 
*78 percent of the Langley scientists and engineers and by 80 percent of the academic/ 
-industrial scientists and engineers^ Ragged right margins were preferred over 
, justified right margins by 62 percelltsof the internal respondents and 61 percen^t of 
the external respondents, ^ 

Column 'layout and right margin treatment were aspects of technical report sur- 
vey and analysis conducted by MoCullough and Pinelli (1982). Their results, 
summarized in Figure 4, indicated that 75 percent of the reports analyzed used a one ^ 
column layout, 22 percent dsed a two column format, and 3 percent had three columns. 
For technical and scientific reports, 90 percent used one column layouts. Technical 
manuals employed double column layouts more frequently (42 percent) than any other 
cajegoxy. ' . ' 
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REPORT CATEGORY 



Figure 4 



Niimljer of columns in layouts of technical publications 
(McCullough and Pinelli, 1982) 



^puD^c 



McCullough and Pinelli 's review of the literature relative to single and 
multiple column layouts revealed that the sources were mixed in their recommenda- 
tions and opinions. Tinker (1963, "p. 116) listed five advantages of double column 
over single .column layouts: ' (1) Higher character/page density, (2) fewer' pages. It 
^ C33 more, logical and economical ]^^^ment of figures and tables, (4) fewer sideways 
visua^l^,— and^-^)-eirtmTTatTOTr-of fol-donts-wd tip-inS. Results of experimental 
studies by Tinker (1963, p. 118), Foster (Rehe, 1974, p. 50), Poulton (1970, p. 208),- 
and Williamson (1966, p_. 117) led many sources to recommend use of double column 
layouts in^^?ientific and technical publications for reasons of increased legibility 
and readers^* preference-. Soar (1951, p. 65) and Tinker (1963, p. 116) reported a 
steady mereai;^ m the use of double column formats in scientific journals over a 
60-year period. , 

Other researchers questioned whether multicolumn layouts possess any, advantages. 
Burt (1959, p. 17) felt that double column measures were too narrow for any publi- 
cation with extensive mathematical material . Kat' and Knight (1980, p. 296), 
Hartley (1974, p. 16), and Burnhlll (1976, p. 13, 17-18) demonstrated that the 
narrow measures encountered in multicolumn layouts retarded the reading rate of 
scanners and speed readers significantly by as much as 200 words per minute. .f- 
Hartley (op. cit.) and Burnhill (op. cit.) both recommended as a result of their ' 
experiments that if a figure is wider than a column, it should be placed at the 
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top or bottom of the page. Bumhill went on to recomraend that if more than 50 per- 
cent of the figures span more than one column in a multicolumn layout, a single ^ 
coluinn layout should be use4 instead. 

In regard to margins, the McCul lough' and Pinelli (1982) study showed that 
60 percent of the survey reports used ragged right-hand margins. Only in the 
categories of technical manuals and reports published by research organi5ations did 
a majority of the documents use justified right-hand margins. Figure 5 illustrates 
the proportions of the overall survey and various document categories which em^oyed 
each margin treatment. 

■■ JUSTIFIED RiGHT MARGINS i 
CD RAGGED RIGHT MARGINS 



100 




REPORT CATEGORY 



Figure 5. Use of justified and ragged right-hand margins 
in technical documents (McCul lough and Pinelli, 1982) 



Williamson (1966) stated that unjustified (ragged) right margins do not 
adversely affect legibility'.' Experiments conducted by Fabrizio, Kaplan, and Teal 
at the U.S. Office of Naval Research (Spencer, 1969, p. 37); Gregory and Poulton 
(Poulton, 1970, p. 208); Hartley and Bumhill, and Wiggins (Rehe, 1974, p. 32); 
and Zachrisson (1965, p. 155) all supported this conclusion. Mills and Walter 
(1978), A Manual of Style (University of Chicago, 1969), and the COSATI guidelines 
(U.S. Federal Council for Science and Technology, 1968) all stated that unj.usitified 
right margins were acceptable. 
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Survey Topic 12; Person and Voice 

Survey respondents were asked to specify their preference in regard to person 
and voice in NASA technical reports. Table JJ.conta^ins the question as it appeared 
xn the questionnaire. Table KK summarizes the results of the internal and external 
respondents. , 

* • 

TABLE -JJ 

^ Te|Xt of Question 14 

Which of the following writing styles do you prefer 
for technical reports? (check only one) 

Passive voice, third person (e.g.. Some success 

has been achieved using empirical methods.)^ 

Active voice, third person (e.g.. Using empirical 

methods, inyestigatoys have achieved some success.) 

Active voice, first person (e.g.. Using empirical 

methods, we have achieved some success.) 



TABLE KK 

Summary: Preferences of Respondents Concerning Person and Voice 



' Response 


\ Percentage 


Internal respondents 
n = 368 


. External respondents 
n ^ 487 


Passive voice, third person 


53.0 


45.0 


Active voice, third person 


20.4 


19.1 


Active voice, first person 


26.6 


35.9 



Among both groups, the passive voice, third person option was chosen most pften 
as the preferred writing style for technical reports. Among LaRC personnel, this 
preference represented a slight majority (53 percent).. Among external respondents, 
the selection rate was 45 percent. The active voice, first person was the choice of 
the second largest block of respondents--27 percent of LaRC respondents and 35 per- 
cent of external respondents. Twenty percent of the LaRC sample group and nineteen 
percent of the external sample ^group preferred the active voice, third person. 

Considering voice alone, Langley engineers and scientists preferred passive 
over active by a 53/47 ratio. External engineers and scientists, on the other hand, 
showed a preference for^active over passive by a 55/45 ratio. 

The majority of both the internal (73 percent) and external (64 percent) 
respondents preferred that third person be used rather than first person in NASA 
technical reports. It should be noted, however, that a higher percentage of external 
group* (36 percent) preferred fir3t person than did the internal group (2-7 percent). 
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The data extracted by McCul lough and Pinelli (1982) concerning use of person 
and vfiice in technical publications are given in Table LL. There was a str6ng 
tendency toward use of the third person in the text material (88 percent of reports) 
and in the sununary material (95 percent of reports)\ The passive voice was used 
more often than the active voice in both text and summary section's. In the text, 
56 percent of the reports used the passive voice exclusively, 38 percetit used the 
active voice exclusively, and 6 percent used both voices. 

TABLE LL , - 



Use of Person and Voice in Technical Reports (McCul lough 

and Pinelli, 1982) 



Report section 


Person (No. 


reports using) 


Voice (No. reports 


using) 


1st 


2nd 


3rd 


Varied 


Active 


Passive 


Both' 


Text (n = 50) 


2 , 


2 


44 


2 


19 


28 


3 


Summary (n = 42) 


1 


0 


40 


1 


18 


23 


1 



The literature review conducted as part of the McCul lough and Pinelli study 
(1982) indicated that the strong tradition which existed in the past for use of the 
passive voice in scientific and technical literature was no longer dominant. This 
was evident from a review of technical writing/editing textbooks, style rtianuals, 
publications manuals, and other literature sources (e.g., Strunk and \\fhite, 1978; 
Stanley, 1975; and Holloway, 1974)'. A very strong consensus of current thinking 
indicated that active voice should be used whenever possible because it is usually 
more direct, natural, and concise. The active voice was favored over the passive 
voice whenever verbs concerned the interaction of inanimate objects and/or the 
writer wanted to emphasize who or what performed the action. The passive voice was 
recommended when the writer wanted to emphasize the receiver of the action rather 
than the doer. 

<« 

Textbooks, style manuals, and l)ublicat ions guides were more divided on the 
question of person. Most did not treat the subject of person. The Publication 
Manual of the American Psychological Association (1974) indicated that experienced 
writers can use first person without sacrificing objectivity or dominating the 
communication. (These ,are the usual arguments against use of the personal pronouns 
"I" and '»we.") On the other hand, Pauley (1979) stated that the use of first and 
second persons should be avoided, and Mills and Walter* (1978) advocated avoiding * 
first person or using it only sparingly. 




FINDINGS , 

The findings were summarized and are presented for each survey topic. The 
following descriptors were usdd ta^present the 'findings , 
f 

Plurality ^ - the largest.' group, but less than half of the 

V respondents 

SubstantiaT Mnority - an opposing response of -25 perjcent or more ^ 

Majority ^ - s5 to 59 percent of tTTe respondents 

Clear Majority - 60 to 69 percent of the respondents 

Strong Majority - 70 to 79 percent of the respondents 

.Overwhelming Majority 80 percent or more of the respondents 

Survey Topic 1: Order^in Which Users Read of Review Report Components 

'{ 

The conclusion was the> component read by the highest percentage of both survey 
groups. An overwhelming majority (98 pejcent internally and 96 percent externally) 
indicated they read the conclusion at some point in their reading sequence. Other 
components read by an overwhelming majority (80 .percent or more) of both groups were 
the results and discussion, t^e suftmiary, and the introduction. 

The preface and foreword were read by only' 19 percent of the users in the com- 
bined groups. An overwhelming majority of both survey groups stated they did not 
read the preface. An overwhelming majority of internal respondents and a strong 
majority of external respondents also indicated they did not read the foreword. 

In the combined surveys, the most common reading sequence for the first six 
components (as determined by a weighted average method) was the title page, summary, 
abstract, introduction, table of contents, and conclusion. Although the abstract 
appears on the last page of NASA reports as part of the COSATI page, this component 
was read by a clear majority of both survey groups, and it was most commonly the 
second or third component read. 



Survey Topic 2: Components Reviewed or Read to Determine Whether to Read the Full 
Repoft 

Respondents from both survey groups indicated the summary, conclusion, abstract, 
title page, and introduction (listed in de(ireasing frequency of use) as the components 
usually reviewed to detisrmine if a report would "'actually be read. A strong majority 
of external respondents and a clear majority of ^internal respondents siated the 
summary was used as one of the screening components. A clear majority of both groups 
named the summary as one of the first three components reviewed in deciding if a 
report would be read. 

A clear majority of LaRC "engineers and scientists used the conclusion and the 
abstract almost as often as the summary in determining whether to read the full report 
For a strong majority (77 percent) of academic and industrial engineers and scientists 
the summary was a clearer choice as a screening component over the conclusion, title 
page, and abstract^ which were named by only a simple hiajority of the respondents. 
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As determined by the weighted average method, the iost consnon sequence used by 
the combjined surveys in reviewing reports for possible reading was the title page, 
abstract, sununary, introduction, and conclusion* 

Survey Topi^ Report Components Which Could Be Deleted 

A clear majority of internal respondents suggested deleting the foreword and the 
preface. A majority of external respondents also named these two components as 
those which could be deleted. .A substantial minority of external respondents indi- 
cated they did not want any components deleted. 

Survey Topic 4: Desirability of a Table of Contents . 

A strong majority .of ii)ternal respondents indicated that only long reports need 
a table of >contents. , A majority of external respondents agreed with that opinion; 
however, a substantial minority in the external respondents indicated that all reports 
should have a table of contents. External respondents expressed the desire for a 
table of contents, twice as frequently as internal respondents* 

Survey -Topic 5: Desirability of a Summary in Addition' to an Abstract 

The internal respondents were fairly evenly divided about whether the more 
detailed summary should be included in technical reports in addition to the abstract. 
A slight majority favored inclusion of both components. Among external responden^^, 
however, a cle^ majority indicated that NASA technical reports should have a summary 
in addition to an abstract. 

Stirvey Topic 6: Location of the Definition of Symbols and Glossary of Terms 

In regard to the location of the definition of symbols and glossary of terms 
in technical reports, a plurality of both internal and external respondents indicated 
their preference for "near front of report." The response chosen by the second 
largest percentage of both sample groups was "near front of report AND where symbol 
or term appears." When these* two responses were combined, a clear majority of both 
survey groups preferred the definition of symbols and glossary of terms to be located 
near .the front of the report as opposed to being placed in the back matter or omitted. 

Survey Topic 7: When Appendix Material Is Read 



A strong majority of respondents in the internal and external survey groups indi- 
cated that they read the appendixes after the text rather than before or with the text. 

Survey Topic 8: Location and Use of Illustrative Materials 

An overwhelming majority of both Langley and academic/industrial engineers and 
scientists preferred that illustrative material be integrated with the text rather 
than grouped separate from the text at the end of the report. When those respondents 
who favored integration of visuals into the text were questioned further, a plurality 
of LaRC engineers and scientists and a majority of academic/industrial engineers and 
scientists indicated a preference for integration regardless of the amount of illus- 
trative material in the report. The remaining respondents (consisting of ^ majority 
in the internal survey group and a plurality in the external survey group) indicated ^ 
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that at varying points, large amounts of illustrative material interrupted reading. 
A substantial minority of LaRC scientists and engineers stated that when there were 
two pages of illustrative material for every page of te)^t, reading was interrupted 
by the amount of the visual material. By summation of the survey groups indicating 
interruption at illustrative-page/text-page ratios of two, three, and four, ifvQan be 
stated that a majority of Langley and a plurality of external respondejiplwHo' ^^^^^--^ 
favore4i, integration indicated that reading would be interrupted if there, were ^four or 
more pages of illustrative material per text page. 

An overwhelming majority of Langley scientists and enginel!^s and a' strong 
majority of academic and industrial engineers and sci^tists indicated that illus- 
trative material was read with the text rather than before or after the text of a 
report. 

Survey Topic 9: Format of Reference Citations 

A clear majority of internal and external respondents preferred that references 
in NASA technical reports be cited in the text by number with a numbered list in the 
back of the report rather than by author/year. 

Sui:vey Topic 10: Specificati^pn of Units for Dimensional Values r 

• There was ^ no overall agfre^ment among either survey group as to how dimensional 
values should be specified ifr-NASA technical reports. Preferences were about equally 
divided between S.I. units and U.S. Customary units. Among the external respondents 
who indicated a preference for U.S. 'Customary units, a clear majority indicated they . 
favored inclusi^on of S.I. units in parentheses following the U.S. Customary units 
rather than use of U.S. Customary units alone. ' / , 

Survey Topic 11 : Column Layout and Right Margin Treatment , 

A majority of both internal and external respondents preferred a one column, 
ragged right margin .format. A substantial minority of LaRC respondents preferred a 
one column, justified right margin format , One column layouts were preferred over two 
column layouts by a strong majority of the internal and an overwhelming majority of 
t\ie external respondents. , Ragged right margins were favored over justified right 
margins by a clear majority of both survey groups. 

Survey Topic 12: Person and Voice 



A majority of internal respondents and a plurality of external respondents 
selected passive voice, third person as the writing style preferred for technical 
reports. A substantial minority of both groups preferred active Voice, first 
person. 

Considering voice alone, a majority of LaRC engineers and scientists preferred 
passive; whereas, a majority of the academic/industrial , engineers and scientists chose 
one of the active voice options. Considering person alone, a strong majority of 
ihtemal respondents and a clear majority of external respondents chose one. of the 
third person, options rather than first person as^ the preferred writing style for 
techttit:al reports.^ * * 
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' VALIDITY OF THE ASSUMPTIONS. 

I ' 

Conclusions were'formed and ai^e presented , concerning the validity of 
the^five assumptions made prior to the start the study. 

Assumption 1: The summary, introduction, conclusions, and illustrative material 
are read most frequently . ' " ' 

Table MM shows for each component, the percentagfes^ of survey respondents who 
indicated a particular component was read at some stage in the use sequence. The 
report components are listed in Table MM in descending percentage of^use. Thef compo- 
nents mentioned in the first assumption are marked with an asterisk. 

By referring to Table MM, it can be seen that the use of the components varied 
between the two survey groups. Assumption 1 was clearly true in regard to the conclu 
sion for both survey groups, in regard to the introduction for the internal survey* 
group, and in regard to the siammary for the external survey group. Illustrative 
material (figures and tables in Table MM) w^s not among the four most frequent^.y read 
components in either survey group. Figures were read by a, higher percentage of both 
survey groups than tables. • 

If the criterion of .overwhelming majority usfe (80 percent or more) by both 
survey groups were used to select components read most frequently, those components 
would be the conclusion, results and discussions, summary, and introduction. Three 
Of these components (conclusion, introduction, and summary) were cited in assump- 
tion 1; however, results and discussions would appear in place of illustrative 
material. 

Assumption 2: One or more of the aforementioned components (summary, introduction, 
conclusions, and> illustrative material) may be the only one(s) read; therefore , 
each of these components should be independent of the remaining components. 

The components used most frequently to review reports are listed in Table NN 
in descending percentage of use by the respondents. The components mentioned in 
assumption 2 are included for comparison and are marked by an asterisk. The summary, 
conclusion, and abstract were the components used most often for reviewing reports 
to determine whether to read the full report. By referring to Table NN, it ca n be 
seen th^"assumpYion 2 was clearly true m regard to t1ie~stMmary~aiTd~uc^ 
somewhat less so for the introduction, and not really so for the illustrative 
material, especially tables. Thus, particular attention should be directed toward 
independence of the summary, conclusion, and abstract in technical reports because 
one or more of thes$ components may be the only one(s,) read by a substantial number 
of readers. (It is less important for the introduction to be capable of being under- 
stood alone. ) ' 
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Examination of Assumption 1 Against Empirical Data 



Internal survey (n^378) 




Ext.ernal survey (n= 


504) 




Percentage 
wno reao 




Component 


Percentage 
who read 


*C6nclusion 


98 




♦Conclusion 


yo 


Results and discussions 


94 




♦Summary 


91 


* Introduction 


89 




Results and .discussions 


90 


Description of research 
procedure 


• 

85 




Title page 


86 


*Figures 


84 




♦Introduction 


82 


*Suniraary 


81^' 




♦Figures 


76 


Title page 


78 




Description of research 
procedure 


■7 A 

74 


Abstract 


71 




Abstract 


65 


♦Tables 


70 




♦Tables 


64 


References ' 


63 




References 


59- 


Appendixes 


62 




Appendixes 


r r 
DO 


Symbol list and 
glossary ' 


48 




Table of contents 


49 


Table of contents 


41 




'Symbol list and 
glossary 


44 ■ 


Preface 


17 




Foreword 


21 


Foreword 


15 


> 


Preface ^ 


20 



♦Assumed to be read most frequently in assumption 1 
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. ' TABLE NN 



Examination of Assumption 2 Against Empirical Data 



Component ^'v 


Percentage of |:^spondents indicating 
use in reviewing reports 


Internal survey 

11 / y 


.External survey 
^ n = 504 


* Summary 


M 


77 


*Conclusion 


67 


58 


Abstract 


63 


■ 57 


Title TJage 


48 


57 


* Introduction 


47 


37 


Results and discussions 


24 


25 


^Figures 


24 


20 ' r.- 


*Tables 


4 


6 



*Assumed to be a component which may be the only one(s) read in 
assumption 2 x 



Assumption 3: The abstract^ along with the conclusions, is sufficient to summarize ■ 
the report, thereby negating the need for a summary . 

A slight majority of LaRC respondents and a clear majority of academic/industrial 
respondents indicated a need for a summary in addition to the abstract in NASA reports. 
However, the results to survey question 1 indicated that 81 percent of the internal 
respondents and 91 percent of external respondents read the summary in technical 
reports. More people in both survey groups read the summary than the abstract. In 
addition, tabulation of responses to survey question 2 indicated that the summary was 

the component used by the highest percentage of both internal and external sampL e 

groups in reviewing reports to determine whether to read the complete report. 
Finally, in response to question 3, only 13 percent of Langley scientists and engi- 
neers and only 7 percent of their external counterpart suggested deleting the summary 
from NASA reports. Based on all of these findings, it is concluded that assumption 3 
is false and that the summary is necessary in addition to^the abstract in NASA reports. 
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Assumption 4: The reading of the entire report may well depend upoTi\he ability 
of the introduction and conclusions, to hold the reader's interest. I 

Data presented in Table NN indicated tjiat the summary, conclusion, and 
abstract were the components used by the highest percentage of survey. respondents in 
deciding whether to read a report. Assumption 4 is thus considered valid in regard 
to the conclusion, but appears ' less ^so for the introduction. The assumption that -the 
reading of the entire report is dependent upon the ability, of certain components to 
hold the reader's ' interest is valid; however, those componen^ts are more correctly 
identified as the summary, cojiclusion, and abstract rather than the introduction and 
conclusion. * ' ■ , 

Assumption 5: The technical report i^s read by audiences having diverse technical 
backgrounds and therefore should be understandable to those who are not expert in 
its subject! - ' ^ 

Several sources cited in the Related Research and Literature section noted the 
diversity or content, subject matter, and intended audiences in discussing the 
technical report literature* Considering these references; the interdiscipliiiary 
nature of many research projects; and the use of reports by managers, engineers, 
scientists, and technologists in government, academic, and industrial work environ- 
ments, it is safe to conclude that assumption 5 is correct. 
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CONCLUSIONS 



^ on an analysis of the data, ,conclusion,s were drawn and are presented for 
eapiT survey topic. , ' * 




Survey Topic 1: Order in Which Users Read or R^yi-etf/Report Components 



'The conclusion was the component read by the highest percentage of both survey 
groups (98 percent internally and 96 perc^ent 'externaNy) . Thus, it is very 
important that a conclusion section appear in every report and that it be independ- 
ent of the rest of the report since many report users who read the conclusion will 
not read other sections. 

The preface and foreword were read by very few respondents. These components 
are seldom used in NASA technical papers and NASA technical memorandums. These 
two report categories constitute the bulk o£ the Agency's report literature. 

In the combined survey groups, the most common reading sequence for the first 
six components was the title page, summary, abstract, introduction, table of contents, 
and conclusion. Although the abstract appears on the last page of NASA reports as 
part of the COSATI page, a plurality of Langley respondents and a substantial 
minority'of external respondents read the abstract second, after the title page. 
Thus, the abstract was shown to be important to the respondents, as evidenced by 
the high percentages of both survey groups which read this component at some point 
in the use sequence (71 percent internally; 65 percent externally) and by'/he 
prominence, of the abstract's position in the sequence of use (usually the second 
or third component read). The higher use by LaRC respondents could- be the result 
of more internal personnel being familiar with the NASA report format. Some exter- 
nal respondents may not be aware that NASA reports contain an abstract and where 
it is Ideated in the report. It may be desirable to make the abstract more acces- 
sible to report readers. This could be accomplished by a change in NASA, pel icy to 
allov the abstract to be placed near the frojit of the report rather than on the 
last page. If this is not possible or desirable, then users could be advised of 
the presence and location of an abstrltt by a notice, perhaps on or following the 
conventional title page- in the front matter. 

Survey Topic 2: Component? -Reviewed 'or Read to Determine Whether to Read the Full 
Report 



'Respondents in the combined survey groups indicated the title page, abstract, 
summary, introduction, and conclusion as the most common sequence of reviewing 
components to determine if a report would actually be read. The summary, conclusion, 
• and abstract were used most frequently as screening tools.. One or more of these 
cdjiponents may be the only ones read; therefore, it is important that each of these 
sections be written so that it can be read and understood .independent of the rest of 
the report. Further, the reading of the entire report may depend on the ability ot 
one or more of these components to hold the reader's interest. Particular attention 
should be directed toward the summary because it was the component utilized as a 
screening tool by the highest percentage of respondents in both survdfTroups . 

Survey Topic 3: Report. Components Which Could Be Deleted 

' A clear majority of internal respondents and a majority of external respondents 
named the foreword and preface as report components which could be deleted. Based 
on these results and ttw^responses to question 1„ which indicated that only 15 to 
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21 percent of report users read the preface and/or foreword, it may be desirable, fol* 
the Agency to omit these GompoTfents from the NASA report fbrmat. 



Purvey To^yi^c 4: Desirability of a^Tablg^j)f Contents 



^Vhdrte a, strongmajority of LaRC respondents and a majority -of external respon- 
dent§ indicated thdfr^only long ^e^orts^eed a table of contents, ti\e number of 
external respondents (43.5 percent||Uvho^thought alj reports should have a table of 
contents was substantial , The tablf^ of contents may^be^more useful to non-NASA \ , 
readers than to N^SA personnel because of less familiarity with the- customary formaty . 
Also relevant to this question were the responses to survey topic 3, to which 
24 percent of the internal respondents, -but only 10 percent of el^ternal respondents, 
named the table of contents as a component which could be deleted^. Based on all 
these findings and the strong consensus in the literature and the 99 reports ^ "^ ^ 
examined by McCullough and Pinelli (1982), it would probably be advantageous for 
NASA to routinely include a table of contents in aWrteports regardless of length. 
The table of contents provides an outline of the report's cfontents in addij:ion to 
serving a locator function. 

Survey Topic 5: Desirability of a Summary in Addition to an Abstract i 

A slight majority of internal. respondents and a clear majocity of academic/ 
industrial respondents indicated the need for a summary in addition to the abstract 
in NASA reports. The results to survey question 1 showed that 81 percent of 
internal respondents and 91 percent of external respondents read t^e summary in 
, technical reports. More people in both survey groups read t^he summary than the 
'abstract. In addition, a tabulation of ^responses to survey question 2 showed that 
the summary was the component used by the ''highest percentage of both internal and 
external sample groups in Reviewing reports to determine whether^ to read the com- 
jPlete document. Finally, in response to question ^, only 13 percent of Langley ^ 
scientists and engineers and only 7 percent of their external counterpart suggested 
delerting the summary from NASA reports. Based on all of these findings, it is con- 
cluded that the suimnary should be retained in NASA reports. 

Survey Topic Sr-'^^ocation of the Definition of Symbols and Glossary of Terms \ 

A clear majority of both^sample groups Sttated a preference for the definition 
of symbols and glossary of terms to be locatted near the front oT the repbrt raither 
than near the back or omitted. The majority of readers did not, indicate the need 
for symbols or terms to be defined where they appear in reports if definition of 
symbols and glossary of terms components were present in the report. By inference, 
it can be concluded that an overwhelfning majority of responden^ts-^f^vored inclusion 
of a symbols list and glossary of terms because they selected a placement option for 
^^^ptTese^omponents rather than the option which stated they were not necessary. 

Results presented for question 1 showed that 52 percent of the internal respon- 
dents and 56 ^percent of the external respondents did not read the symbol list and 
glossary. Considering this result alone, the need for these components might be 
questioned. However, the responses to survey question 3 revealed that only 6 percent 
of^aRC and oni^ 6 percent of external respondents suggested deleting thejj^symbol list 
and giossary. 

Thus, it can be concluded that while the majority of respondents do not a.ctually 
read tl^ie definition of symbols and glossary of terms, they indicated that these compo- 
nents should be present for reference purposes. The most preferable placement from the 
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respondents' viewpoint is near the front .pf the report. NASA* s 'present practice of 
"^locating the symbols .list as body matter following the introduction may need to be 
changed beca^ise the present location was found in the McCullough and Pinelli study 
(1982) to interrupt the continuity from the introduction to the rest of the text and 
to be less accessible to the reader^ as a reference tool. 

Survey Topic 7: When Appendix Material Is Read , t 

Based on the results showing that a strong majority of report users read 
appendix material ^fter the text rather than before or with the text, the present 
placement of appendix material by NASA is satisfactory. 

Survey Topic 8: Location and Use of Illustrative Material 

Illustrative material in NASA technical reports should be integrated J«ji^th the 
text rather than grouped together at the end of the report. This conclusion /is 
based on the findings that an overwhelming majority of^Langley and academic/'^^ * 
industrial engineers and scientists read illustrative .material with rather than 
**^pfnr*^ or after the text and prefer illustrative material to be integrated with the 
text rather than grouped together at the end of the report. In addition, McCullough 
and Piiielli (1982) found that an overwhelming majority of technical reports had 
figurei and tables integrated with the text. Also, the majority of literature 
sources consulted during that study recommended the integration of visuals. 

Th6 i;esu]^ts of.moje^detail|d questioning of respondents who favpred the integra- 
tion of visual^s confirmed the Aeed fqT the Inco^pei^ati^a. o£ tab^^^s^^d figures in the 
text material. A plurality of '•LaRC resj^ond^ts and a majority pf external' respond en'ts 
indicated a preference' for integration regardless of the "^ount of illustrative 
material in a report. It does appear, however, that at a point when there were four 
or more pages of illustrative material per page of text, a majority of LaRC and a 
plurality of external respondents indicated that reading would be interrupted by the 
volume of the visual material. Thus, the mandate to integrate illustrative material 
was somewhat T&miJered by a consideration«^f amount; hpwever, results of the McCullough 
and Pinelli (1982) project showed that only in rare instances would th^t amount of 
illustrative material appear in any technical report* 



Survey Topic 9: Format of Reference Citations 




A clear majority of both internal— afrfd external respondents expressed a prefer 
ence for references to be cited in the text by number (with a numbered list in the 
.hack of the report) rather than by author/ye^r. Based on this finding, it can be con- 
cluded that from the respondents' perspective, citation by number is the preferred 
format for references in NASA teclThical reports. 

Survey Topic 10: Specification, of Units for Dimensional Values 

It cgin be concluded th^t there is no general agreement either among internal 
or external respondents as to whether dimensional values in technical reports should 
be given in International System (S.I J units and/or U.S. Customary units. Since 
responses were about equally divided among four options, NASA's present practice 
of using S.I., units as the primary system with U.S. Customary units perihitted in 
parentheses or as a secondary system appears satisfactory. \ 



Survey Topic 11: Column Layout and Right Margin Treatment 

A majority of internal and external survey respondents preferred NASA^s 
present format-^one column, ragged right margin--over two columns and/or justified 
right mSirgins. No changes are Iju^icated in NASA reports in regard ^o this survey 
topic It is concluded that mSA^.s current format is quite satisfactbry. 

Survey- Topic 12: Person and Voio^ 

From the findings of the survey and the McCul lough and Pirelli study (1982), 
it can be concluded that ttird person rather than first; person is t\\% clear majority" 
choice, for technical report writing. In regard to voice, any conclusions are less"^ 
well 4^fined. The passive j/oice was preferred by more LaRC respondents, but the 
active voice was prefeirred by more of their academic/ industrial counterparts. In 
reports analyzed by McCullough and Pinelli, mor^, documents were written in passive 
voice than in active voice, but the statistics were closer than those on person. 
Further, the McCullough and Pinelli literature review revealed a strong consensus 
of thinking in current sources that use of the active voice should be encouraged in 
technical reports whenever possible as the active voice was deemed more natural, 
\ concise, and direct. The Agency*s current guidelines do not discuss person or voice. 
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APPENDIX A 
SURVEY QUESTIONNAIRE 



_ NASA Technical Report Format 

. These questions are desired to determine how NASA technical reports are read and the preferred format of our readers. 

1 The format for a typical NASA technical report appears below. Please number IN ORDER the components you 
generally read/review. (For example, if you read the "ABSTRACT" first, number it with a Do not number 
those components you skip. i 

a Title Page 

b Foreword 

1-30 (number I, 2,^ctc.) , c Preface , 

(ignore items:you do not read) d Table of Contents ' ' 

p e. l_ Summary 

f. Introduction 

g. Symbol List and Glossary 

h Description of Research Procedure 

^ i. Results and Discussions 

j. Conclusion 

^ k Appendixes 

'* ^ I. — L References ' . 

m Tables 

^ n. Figures 

0. Abstract 

*■ * 

2 Referring to the list above, which NASA report components do you review or read to determine if you will actually 
READ THE REPORT? (please list letter from list above in the order you review them) 

3H0 ' 



review review review review review 
first second thicd fourth fifth 

3*. In'^our opinion, which of the above listed (iii q. 1) report components could be deleted? 

. -.V*^,.. o.^^ , 



4. Should ALL technical reports have a Table of Contents (regardless of length of report)? 
Yes, all should. No, only long reports need it. ^ ^ 

5. Given that NASA reports contain brief abstracts (about 200 words) m the back, do you also need the more detailed 
summary section (which appears in the front)? 

' Yes. include a summary, too. ' ' No, don't bother with it. 

6. Where in a NASA technical report should a Definition of Symbols and Glossary of Terms appear? (check only one) 
, Near front of report 

Near back of report 

Near front of report AND where symbol or term appears ^ * 

Near back of report AND where syrfibol or term appears 

NO Symbol List or Glossary of Terms needed, just define symbol or term where it appears in report 



7. When Appendixes appear in a technical report, when do you usually read tliem? (check only one) 

, Before the text 

With the text 

After the text 

t 
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8. Where in a NASA'techmcal report should the illustrative material (tables, graphs, photographs, etc^ appear'' I 

Integrated with text ^ ' \ 

Separate from text; at end of report * | 

9. If lUusiraiive material should be integrated, is there a point at which the illustrative liuterial interri/pts your reading'* 
(check only one) 

Yes, when there are two pages of illustrative material for every page of text 

Yes, when there are three pages of illustrative materiarfd'r every page of text 

Yes, when there are four or more pages of illustrative material for every page of text ^ 

No, I always prefer to have illustrative material integrated in text 

10. When do you usually read illustrative material? (check only one) 
Before the text 

With the text 

After the tex^ 

1 L Which of t|ie following two forms of reference citation do you prefer for technical reports'* (check one) 

Cited in text by author/year (e.g., Jones 1978) with an alphabetical list in back of report 

Cited in text by number (e.g., reference 16) with a numbered list in back of report 

12. How do you prefer to have dimensional values specified in reports? (check only one) 
The International System (S.I.) units (e.g., meter, kilogram) 

VS. Customary units (e.g., foot, pound) 

S.I. units with VS. Customary units in parentheses 

VS. Customary units with S.I. units in parentheses 

13. Which of the* following forms of layout do you prefer for technical reports? (check only one) 
One column ; ragged right margin 

One column;justified right nyirgii) ^ 

' Two columns; ragged right margin 

^ im columns;'jUstified rfght fnarglft ' ^ - 



14. Which of the following writing styles do you prefer for technical reports? (check only one) 
Passive voice, third person (e.g.. Some success has been achieved using empirical methods.) 

Active voice, third person'(e.g.. Using empirical me^thods, investigators have achieved some success.) 

Active voice, first person (e.g.. Using empirical methods, we have achieved some success.) 

USE OF SCIENTIFIC AND TECHNICAL INFORMATIOI^ 

These questions are designed to determine your use of published scientific and technical information. , 

15. Do you use non-NASA authored literature in your research? 

a. technical repor^lliterature yes .no not sure 

b. journal articles yes ^"no not sure , 

c. conferencc/meeting'papers — ^ yes no not sure , 

1 6. Do you use NASA-authored literature in your research? ^ i 

a. technical report literature yes , no ' not sure 

b. journal articles - — yes / no —l— not sure 

c. conferencc/jneeting papers y^s ' no ' not sure 

11. Do you use literature authored by Langley Research Ceifter personnel? 

a. technical report literature yes r no not sure 



b. journal articles yes no not sure 

-notst 
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c. conference/meeting papers yvt^^^ 7ST-"0f —-not sure 

(1) (2) t yi) 
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YOUR IMAGE OF NASA AND LANGLEY-AUTHORED^ PUBLISHED INFORMATION 



Scientific research is Important IS 


□ □ 


□ □ Unimportant 


Check 1 for "very important" 


Check»4 for 


"somewhat unimportant" 


Check 2 for "somewhat important" 


Check 5 for 


"very unimportant" 


Check 3 for "neither important nor unimportant" 
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71 

72 

73 
74 

75-77^ 
7S-80 



Higher □ □ □ □ □ Lower ■ not familiar with those from NASA 

When compared to other journal articles in my field, the PRESTIGE of Langley -authored journal articles is 

Higher □ □ □ Q □ Lower not familiar with those from Langley 

19 When compared to other technical report literature in my discipline, the PRESTIGE of NASA-authored technical 
reports is 

Higher □ □ □ □ □ Lower not familiar with those from NASA 

When compared to other technical report literature in my disciphne, the PRESTIGE of Langley-authored technical 



reports is 

Higher □ 
(1) 



□ 

(2) 



□ 

(3) 



□ 

(4) 



□ Lower 



(6) 



not familiar with those from Langley 
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Higher □ 

(0 



20 When compared to other technical report literature in my disciphne, the ADEQUACY OF DATA in NASA-authored 
technical reports is 

Higher □ □ □ □ □ Low<5r not familiar with those from NASA 

Whea compared to other technical report literature in my discipline, the ADEQUACY OF DATA in Larigiey -authored 
technical reports is ' 

Higher □ Q □ □ Lower not familiar with those trom Langley 

21 When compared to other technical report literature, the QUALITY OF VISUAL PRESENTATIONS in NASA- 
authored technical reports (e.g.. graphics, photography, type style) is 

Higher □ □ □ □ □ Lower not familiar with those from NASA 

When compared to other technical report hterature, the QUALITY OF VISUAL PRESENTATIONS in Laogley- 
authored technical reports (e.g., graphics, photography, type style) is 

(2) (3) (4) (5) ^^^^^ * ——not familiar with those from Langley 

NASA SCIENTIFIC AND TECHNICAL INFORMXflO>^ ' , ^ ^ 

22 In terms of "ADVANCING THE STATE OF THE ART," NASA-authored scientific and technical information is 

Higher □ □ □ □ □ Lower riot familiar with those from NASA ( 

In terms of "ADVANCING THE STATE OF THE ART," Langley-authored scientific and technical information is 
Higher □ t^v □ □ □ Lower not familiar with those from Ungley 

23. For my research, NASA scientific and technical information is 
Important □ □ □ □ □ Unimportant 

24. In terms of my^ professional advancement/development, publishing is ^ 
Important □ ' □ □ □ • '□ Unimportant 

25. In my organization^ publication is^ . ^ 
Encouraged □ □ □ □ □ Discouraged 

CoQ±inued On Next. Page 
"TS 
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26. Formy research, I usc:;(chcck appropriate boxes) 

Always Usually Sometimes Unfamiliar with 

a. STAR (Scientific and Technical Aerospace Reports), ' 

the NASA announcement journal for report literature □ * □ □ □ 

b lAA (International Aerospace Abstract), the NASA 
announcement journal for periodicals, meetmg papers, 

and conference proceedings □ □ □ D 

c. SCAN (Selected Current Aerospace Notices), a NASA ,^ 

current awareness publication □ □ □ D 

d. NASA literature searches obtained through NASA 
Scientific and Technical Information Facility, NASA 
libraries. Defense Te(ihnical Information Center, or 

Dept. of Energy ' □ □ / □ . □ 

BACKGROUND 

The purpose of these questions is to determine whether peuple with different backgrounds all have different opinions The 
answers will NOT be used to identify anyone. - * , 

27. Total years of professional worl^expcrience less than 1 year 1-5 years 6-10 years 

^ ll-15years 16-20years ^ 21+years 

' 28. MAJOR field of interest (check only ONE, please) 

aeronautics geosciences 

chemistry and materials life sciences 

astronautics space sciences 

math and computer science structural analysis 

physics electronics/electrical 

TO BE ANSWERED BY NON-LANGLEY PERSONNEL ONLY 

. 29. Type of organization you work at: , 
industrial organization 

not-for-profit organization s: 

♦ educational institution ^ 

NASA 

other government agency 

other (please specify) 

30. Present professional duties (check the ONE that most applies): 

basic research private consultant 

applied rescai-cj^ r —technical administration 

teaching/academic (may include research) other (please specify) — 



V 



TO BE ANSWERED BY LANGLEY PERSONNEL ONLY 

31. Your position within the organization (check one): 
individual contributor 

unit, group, or section head ' ^ 

branch/assistant branch head 

division/assistant divisior; chief " * * 

32. How many years have you been With Langley? 

less tlian 1 year 1-5 years 6-10 years 

11-15 years^ 16-20 years 21+ years ^ 



^3.^ Research organization assigned to (e.g., ACD, FED, MATD.)v 



^ * * (Please specify) 
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APPENDIX A 
PROGRAM IMPROVEMENT (Please fill this out last.) 

1 . Are there comments you would like to add about t9^pics covered in this questionnaire 



2. Are there comments you would like to add about anythmg not previously mentioned? 



• ^ ' T 

3. What can be done to make NASA-generated research more accessible to you? 



APPENDIX B ' 'J 
National Aeronautics and^ REQUEST FOR PARTICIPATION : 

Space Administration CENTER DIRECTOR'S TRANSMITTAL LETTER' m\§t \ 

UngleyRes©ar^5trCentef 

Hannpt». Virginia 
23665- 



Ptpty to Ann of 



Approximately 18 months ago, a review and evaluation of the Center's scientific 
and technical information (STI) program was lindertaken. The purpose of the study 
was to determine the areas or portions of the Center's STI program which could be 
improved. Many of the study's recommendations h^ve, already been implemented. \| 

The final phase of the §'tudy involves a review of the NASA technical report 
format as an effective medium for transmitting information. The review will focus 
on the organization of the report, the component parts, and their relationship 
within the total report context . The goal of the study is to determine if the 
NASA report format can be improved. ' 

^ ^ ; ; : . 

Mail-in questionnaires will be u^ed to^obtain the desired data. A representat^-ve 
sample of participants w^ill be selectecl from three professional/technical societies 
(e.g., AIAA, IEEE, and AGU) and from the Langley Research Center. The confidential 
responses will be tabulated and analyzed by an independent research firm to 
provide' valuable insights into the NASA techtiical report and NASA/Langley STI. 

Your name has been selected at random to participate in the study. Please 
complete and return the enclosed suryey questionnaire ^by January 19, 1982, to 
Continental Research, Box 6112, Norfolk, Virginia 23508, using the prepared 
enclosed envelope. 

I endorse this effort and request your participation and cooperatiqn. The 
intended outcome of this study is to improve the overall organization and 
format of .the NASA technical report and to improve its effectiveness as a medium 
for Information dissemination. 



Sincf Jely , 




bonald P» riear/h 
Director 

Enclosure 
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' APPENDIX C ^ * 

^ REhaNDER/APPRECIATION LETTER: > * ' a 

Lontinent ol Keseorch internal survey ^ ^ 

^ - 4500 CoUey Avenue 

Norfolk Vo 23506 ' 
(604)489 4887 

' A . . ' ■ 
February 3, 1982 ^ v ' I 



Someone from my office tried to call you last week to be 
certain that the NASA technical report survey had arrived. 
Since you were unavailable, I just wanted to be sure you 
know how much your effort was appreciateid. The snjrvey 
was mailed from NASA on January 4, 1982. If you have not 
^ — • received it, please call me at 1-489-4887. 

Thanks so much! 

Sincerely, 



_^^^_^Nancl_^., G passman ^ , , > r 

NG/ray ' : , ' - " J ' 



82 ' ■ \ 

^|^(]] . ^ Mork^nng. Advemsing. Polificot ond Sociol Problerns 



^ I APPENDIX D 

* ' ''COVER LETTER • 

onrinenfQl Research immM survey 



4500 Coiiey Avenue 
NcyfoJK vo 23508 
604' 48<> 4887 



r 



January 1982 



r 



Thank you for your willingness to .participate in the pre-test phase 
of this study being done for the National Aeronautics and Space 
Administration. This is one phase of a project to review and evaluate 
NASA's scientific ^d technical information program. *A sample of a 
typical NASA technical report has been enclosed for'yoi^r reference. 

Your opinions are vital. Please complete the enclosed anonymous survey 
today and return it to me ac Continental Research, »P. 0. Box 6lI2, 
Norfolk, Virginia 23508, using t^e/pre-paid envelope, prqvided. 

Your cooperation is appreciated. . 

Sincerely, 



Nanci A. Classman 
President 

NG/js 

EnclosuresJ 1 pre-test survey 

1 pre-paid envelope 

i postcard 

, 1 somple'^report 
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-APPENDl^X-^^ 



Conrlnentol Re search ^^^^^^^g^^^f^jg; ^^^^'^^ ' 



^bOO Coney Aven- 
Nprfo^k Vo 23506 

604 4d9 4dd7 




February 3>, 1982 



Just a note to thank you for your willingness to participate in our 
pre-t^st survey for the Nat ional Aeronautical and Space Administration. 



Someone from my 'office tried to call you last week to be cei:tain that 
the survey had arrived and to thank you for your help. Since you were 
unavailable, I just wanted to be sure you know how much your effort 
was appreciated. " ' ' 

Thanks so much! 

Sincerely, . 



N^nci *A. Glsssman 
President 

NG/js 
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-.-^-..^ APPENDIX F* 

QUESTIONNAIRE WITH AGGREGKATE TALLIES: 
INTERNAL SURVEY 

NASA Technical Report Format 

These questions arc desjgneU to determine how NASA technical reports are read and the preferred format of our readers 

1. The formatVor a typivil NASA technical report ajipears below. Please number IN OtoER the components you 
generally read/review. (For example, if you read the "ABSTRACT" first., number it with a Do not number 
those components you skip. 

a TitlePage See "Table D(p. 21 ) 'for 

b* Foreword aggr^grate 'tallies for 

(number 1,2. 3. etc.) c Preface " question 1' 

(ig;nore* Items you dw not read) d Table of Contents 

e Summary 

' - - ' - ' — -f-^ Introduction- 

g. Symbol List and Glossary 

h Description of Research Procedure 

I Results and Discussions 

>^ J Conclusion 

k Appendixes 

1. References t 

, m Tables ^ 

n. Figures 

o. Abstract 

2. Referring to the list above, which NASA report c6mp6nents do you review or read to determine if >ou will actually 
READ THE REPORT? (ple.ase list letter from list above in the order you review them) 

See Table J(p.27) for 



review review review review review 



fust «cond third fourth f.fth aggr,egrate tallies for 

f . question 2* 

3 In your opinion, which. of-the above listed (in q. 1) report components could be deleted'' 

' [ . See Table 0 (p. 31) for 

/ aggregrate tallies for 



4. Should ALL technicalrcports have a Table of Contents (regardless o^Ye1igtii"of"rep0rt)? 
22.1%^^^ all should. 77. 9%M^^niy j^^g reports need it. n=376 



\ 



5. Given that NASA report^ contain brief abstracts (about 200 words) m the back, do you also need the more detailed 
summary section (w hich appears in the front)? ' 



5 1,l% Yeg include a summary, too. 4?».9^o, don*t bother with it. n= 37U 

6. Where in a NASA technical report should a Definition of Symbols and Glossary of Terms appear^ (check only one) 
48 Near front of report 

1 2 Near back of report ^ ' ^ - , 

20^-Si.Near front of report AND where symbol or term'appcars n=375 

8 . 3% Nea> back of repor^ND where symbol or term appears ' ^ 
10.4-i- n6 Symbol List otolossary of Terms needed, just define symbol or term where it appears in report 



7. When, Appendixes appear ii^technical report, when do you usually read them'' (check only one) 
lj&^ Before the text ^^^^ J ^ ^ 

. 22aiiWith the text ^ ^ ""^"^^ 

76JtiAfter the text ' ^ • 



APPENDIX F • ' ' 

i 

j 

8 Where in a NASA technical /ep?rt should the illustrative material (tables, graphs, photographs, etc.) appear'^ 
80 -3% Integrated with text - ^ . r 

19^ Separate from text; at end of report . n=375 

9 If illustrative material should be integrated, ii there a jjoint at which^he illustrative material mterrupts your readmg 
(check only one) 

25-S$Yes, when there are two pages of illustrative material for every page of text n=298 
1 7^1% Yes. when there are three pages of illustrative material for every page of text 

S^diYes, when there are four or more pages of illustr^ve material for every page of text 
^ 9^2^o, I always prefer to have illustrative material integrated in text 

10. When do you usuall)K read illust(;ative material? (check only one) 
l^^Befofcthelexr'™'^ ' ' . - - 

e2^With the text ^ ' < n-Zll ' 

' ?.7%After the. text 

1 1 Which of the following two forms of reference citation do you prefer for technical reports'^ (check or\t) 
35-£i Cited in text by author/year (e.g.. Jones 1978) w;th an alphabetical list m baqj: of report 
5^^^ Cited in text by number (e.g., reference 16) with a numbered list m'back of report ^=371 

12. How do you prefer to have dimensional values specified in reports? (check only one) 
22,i_SlThe International System (S.I.) units (e.g., meter, kilogram) 
2^^j-ZI.U5.Cusjomary units (e^., foot, pound) j " ' n=374 
25.^7^ S.I. units with U-S. Customary units in parenthes«s 

^2/2^ U^. Customary units with S.I. units in parentheses 

13. Which of the following forms, of layout do you prefer ifo( technical reports'' (check only one) ^ 
5 3. Ji^pne column; ragged right margin 'w ' * 

2** jlJ3l^. One colu^nn ; justified right margin « \ n= 36 5 

')8a-Si. Two columns: ragged right margin 

12.t5^ Two columns: justified right margin ^ ^ ' , 

14. W^ich of the following writing styles do you prefer for technical reports'' (check only one) 
^^i^Passive voice, third person (e.g.. Some success has bden achieved using empirical methods.) 

20 Active voice, third person (e.g.. Using empiricaknetno^, investigators have achieved isome success.) 
25 J|% Active voice, first person (e.g.. Using empirical metf^4s^we have achieved some success.) 
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A?PENM-'ff X . . . . 

QUESTIONNAIRE WITH AGGREDRATE TALLIES: 
NASA Technical Report Foi:mat EXTERNAL SURVEY 

These questions are designed to determine how NASA technical reports are read and the preferred format of our readers 
-^^ 1 The format for a typical NASA technical report appears below. Please number IN ORDER'the components^^u 

generally read/review. (For example, if you read the **ABSTRACT" first, number it with- a *M.'") Do not number 
those components you skip. 

a Title Page See Talrle E( p. 22) for 

' b Roreword * aggregrate tallies for 

j^^Q (number 1.2. 3. etc.) c. ^Preface ^ question 1. 

(ignore items you do not read) dj« TaWe of Contents 

e Summary 

' ' f. , Introduction 

g. Symbol List and Glossary 

h Description of Research Procedure 

1 Results and Discussions , 

^ J _:_ Conclusion 

k Appendixes 

I. References 

m Tables 

n. Figures 

0. Abstract ' 

2 Referring to the, list above, which NASA report components do you review or read to determine if you will actually 
READ The REPORT'' (please list leftehfrbm list above in ihe order you review them) 

31^0 * ' See Tabic K( p. ) for 

review review reyiew review review aggregrate tallies for 

first second third . fourth fifth quest ion 2 . 



41^50 



In your opinion, which of the above listed (m q. 1) report components coulAbe deleted? 

See Table 0 ip. Ji; ror 

aggregrate tallies for 

^ ^ question 3. 



' . 4. Should ALL technical reports have a Table of Contents (regardless of length of report)'^ 

^3^Yes. all should. 5S^%No. only long reports need it ^ ,n=503 ^ 

5 . Given that NASA reports contain brief abstracts (abouf 200 words) ih the back, do you ahg need the more detailed 
summary section (which appears'in the front)? r ^ ^ * 



52 6 8j^Yes. include b summary, too. 31i3_%vfo, don't bother witii it. n=U96 

6. Where IM NASA technical report should a Definition of Symbols and Glossary of Terms appear-^ (check only on?) 
^7_JjNear front of report 

/ lS.L^Near back of report^ ^ 

16j^Near froiit of report AND where symbol or term appears n= 501 

9j^Near back pf report AND where symbol or term appears 
12^N0 Symbol List or Glossary of Terms needed, just define symbol or term where it appears in reporl 

V 

<* ' * 

7. When Appendixes appear in a technical report, when do you usually read'thcm'' (check only one) 
ZJl^efore the text * ^' 

2(L^ith the text 

VT-AWter the text * n=U98 * 
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8 Where in a KASA technical report should the illustrative material (tables, graphs, photographs, etc.) appear'* 
^^0.4-2^nlegrated with text 
, - - i9.uE^parate from text, at end of report n=500 

. ^ 9 If illuiiratrve material should be integwted, iS there a point at which the ilIustrativc'TTiatenal interrupts > our reading^ 

(check only one) 

19 — l^es. when there are two pages of illustrative material for every page of text 

T'O^^es. when there are three pages of illustrativemiaterial for every page of text n=399 

Z^^cs, when there are four or more pages of illustrative material for every page of text 
b.^^Vo, I always prefer to have Ulustrative material integrated m text 

10 When do you usually read illustrative material (check only one) 
i l-JI^efore tfie text ' 
p^l^Wiih the text n = 500 

i-^'IAfter the text 

I !. Which of the following two form's of reference citation do you prefer for technical rep^orts** (check one) n=494 
36-^Xited in text by author/year (e.g., Jones 1978) with an alphabetical list in back of report 
6ii-JlXited m text by number (e.g., reference 16) with a^ numbered hst in back of report 

\2' How do you prefer to have dimensional values specified in reports'' (check only one) 
2Li^^he International System (S.I.) units (e.g., meter, kilogram) 
17 ■ 9%jS. Customary unti§ (e.g., foot, pound) 
2 ^ . units with U^. Customary units in parentheses 



n=uog 

32JI^.S. Customary units with S.I. unifs in parentheses 



13 Which of the following forms of layout do you prefer for technical reports'' (check only one) 
^ 5b . 3 One column; ragged right margin 

One column, justified right margin , n=t483^ 
^ iLi-L^wo columns, ragged nglit margin 

1^ - 7%'wo columns; justified right margin / / 

14. Which of the following writing styles do you prefer for technical reports? (check only one) n=487 
LLiil Passive vOice, third person Some success has been achieved using empirical methods.) 
1* ^ > ^ Active voice, third person (e.g., Usmg empirical methods, investigators have achicvedsome succfess.) 
- 35.iJ9f^ctive voice, first person (e.g.. Using empirical methods, we have achieved some succ^ss.)^ 
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A survey of engineers and scientists at NASA's Langley Research Center (LaRC) and in the academic/ 
industrial communities was conducted to determine the opinions of readers concerning the format (organiza- 
tion) of NASA teduycaLLepojts and usage of technical report components. A survey questionnaire was sent to 
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and abstract, the location of the symbols list and glossary, the integration of illustrative material, the preferred 
format for reference citations, column layout and right margin treatment, and person/voice. 

The validity of five assumptions was tested. Conclusions were drawn from the 14 questions which were 
■ grouped into 1,2 survey topics. The results of the reader preference survey indicated that the conclusion w^s 
the componeft most often read by survey respondents- The summary, conclusion, abstract, title page, and 
introduction were the components used most frequently to determine if a report would actually be read. 
Respondents indicated that a summary as well as an abstract should be included, that the definition of sym- 
boTslncTglosTayy^f termslh^iild^ocaterin tfie^^^ 

integrated with the text rather than grouped at the end of the report. Citation by number was the preferred 
format for references. A oneH:olumn, ragged right jnargin was preferred. Third^person, passive voic« was the 
style of writing preferred'by the respondents. - 'i ' 
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